-- Logs begin at Mon 2022-05-30 11:21:51 UTC, end at Mon 2022-05-30 12:33:16 UTC. -- May 30 11:54:55.024766 dv-cinder-840512-2-smb systemd[1]: Starting Devstack devstack@keystone.service... May 30 11:54:55.032013 dv-cinder-840512-2-smb devstack@keystone.service[80329]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 30 11:54:55 2022] *** May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: nodename: dv-cinder-840512-2-smb May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: machine: x86_64 May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: clock source: unix May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: pcre jit disabled May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: detected number of CPU cores: 4 May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: current working directory: / May 30 11:54:55.034996 dv-cinder-840512-2-smb devstack@keystone.service[80329]: detected binary path: /usr/bin/uwsgi-core May 30 11:54:55.035560 dv-cinder-840512-2-smb devstack@keystone.service[80329]: your processes number limit is 47680 May 30 11:54:55.035560 dv-cinder-840512-2-smb devstack@keystone.service[80329]: your memory page size is 4096 bytes May 30 11:54:55.035560 dv-cinder-840512-2-smb devstack@keystone.service[80329]: detected max file descriptor number: 2048 May 30 11:54:55.035560 dv-cinder-840512-2-smb devstack@keystone.service[80329]: lock engine: pthread robust mutexes May 30 11:54:55.035560 dv-cinder-840512-2-smb devstack@keystone.service[80329]: thunder lock: enabled May 30 11:54:55.035560 dv-cinder-840512-2-smb devstack@keystone.service[80329]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 30 11:54:55.035560 dv-cinder-840512-2-smb devstack@keystone.service[80329]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 30 11:54:55.080782 dv-cinder-840512-2-smb devstack@keystone.service[80329]: Python main interpreter initialized at 0x563733c629c0 May 30 11:54:55.080782 dv-cinder-840512-2-smb devstack@keystone.service[80329]: python threads support enabled May 30 11:54:55.080782 dv-cinder-840512-2-smb devstack@keystone.service[80329]: your server socket listen backlog is limited to 100 connections May 30 11:54:55.080782 dv-cinder-840512-2-smb devstack@keystone.service[80329]: your mercy for graceful operations on workers is 90 seconds May 30 11:54:55.081147 dv-cinder-840512-2-smb devstack@keystone.service[80329]: mapped 403077 bytes (393 KB) for 2 cores May 30 11:54:55.081223 dv-cinder-840512-2-smb devstack@keystone.service[80329]: *** Operational MODE: preforking *** May 30 11:54:55.081491 dv-cinder-840512-2-smb devstack@keystone.service[80329]: *** uWSGI is running in multiple interpreter mode *** May 30 11:54:55.081491 dv-cinder-840512-2-smb devstack@keystone.service[80329]: spawned uWSGI master process (pid: 80329) May 30 11:54:55.081693 dv-cinder-840512-2-smb systemd[1]: Started Devstack devstack@keystone.service. May 30 11:54:55.083743 dv-cinder-840512-2-smb devstack@keystone.service[80329]: spawned uWSGI worker 1 (pid: 80343, cores: 1) May 30 11:54:55.083743 dv-cinder-840512-2-smb devstack@keystone.service[80329]: spawned uWSGI worker 2 (pid: 80344, cores: 1) May 30 11:54:55.083743 dv-cinder-840512-2-smb devstack@keystone.service[80329]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 30 11:55:00.799691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:55:00.799691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: from cryptography.utils import int_from_bytes May 30 11:55:00.800341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:55:00.800341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: from cryptography.utils import int_from_bytes May 30 11:55:00.800779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:55:00.800779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: from cryptography.utils import int_from_bytes May 30 11:55:00.800913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:55:00.800913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: from cryptography.utils import int_from_bytes May 30 11:55:00.850643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 11:55:00.850816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 11:55:00.850914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 11:55:00.851011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] command line args: [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 11:55:00.851084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 11:55:00.851198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] command line args: [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 11:55:00.851300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 11:55:00.851449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ================================================================================ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 11:55:00.851569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 11:55:00.851652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ================================================================================ {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 11:55:00.851731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] admin_token = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.851879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] admin_token = **** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.851965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] config_dir = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] config_dir = [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] config_source = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] debug = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] config_source = [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] debug = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.852928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.853161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.853263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.853374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.853475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.853573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.853678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.853779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.853886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] list_limit = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_config_append = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] log_config_append = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854674 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_dir = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] log_dir = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.854992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] log_file = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.855941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856227 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.856886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857674 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.857864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.858024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.858377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.858514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.858602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] publish_errors = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.858687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] publish_errors = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.858783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.858921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.859875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] standard_threads = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] standard_threads = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_journal = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_json = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] use_journal = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.860936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_stderr = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.861007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] use_json = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.861127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] use_syslog = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.861210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] use_stderr = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.861310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.861398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] use_syslog = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.861554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:55:00.861639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.861797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.861876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.862071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.862165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.862313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.862393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.862564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.862648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.862802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.862890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.863046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.863161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.863283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.863425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.863530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.863617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.863775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.863854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.864983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.865137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.865219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.865293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.865454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.865534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.865696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.865786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.865952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.866049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.866224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.866306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.866463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.866551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.866702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.866789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.866960 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.867039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.867213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.867299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.867464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.867550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.867697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.867776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.867927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.868954 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.869108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.869188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.869375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.869453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.869610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.869695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.869861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.869940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.870127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.870207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.870367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.870451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.870598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.870676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.870836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.870929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.871965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.872069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.872207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.872286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.872452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.872586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.872672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.872885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.872970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.873126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.873205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.873363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.873446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.873598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.873721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.873861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.874859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.875955 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.876036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.876190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.876273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.876425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.876518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.876663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.876749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.876901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.877932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.878119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.878202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.878367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.878445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.878611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.878690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.878850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.878932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.879087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.879166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.879322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.879409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.879562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.879648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.879798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.879877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880412 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.880994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.881157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.881245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.881399 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.881479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.881642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.881722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.881885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.881996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.882149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.882229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.882386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.882466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.882629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.882718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.882868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.882948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.883103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.883183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.883339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.883421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.883569 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.883649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.883799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.883938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.884030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.884107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.884254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.884334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.884483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.884562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.884715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.884796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.885459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.885546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.885692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.885770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.885932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.886077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.886197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.886277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.886449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.886532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.886691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.886772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.886924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.external = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] auth.external = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.password = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.887992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.888128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.token = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.888234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.888372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.888558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.888640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.888803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] auth.password = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.888884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.889040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] auth.token = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.889130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.889288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.889369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.889532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.889612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.889761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.889849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.890997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.891077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] credential.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.891242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.891398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.891476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.891556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.891728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.891809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.891967 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.892054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.892208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.892289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.892445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.892523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.892714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.892804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.892973 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.893052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.893212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.893291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.893469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.893600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.893729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.893811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.893978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.894061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.894228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.894323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.894477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.894558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.894725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.894805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.894956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.895045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] federation.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.895202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.895291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.895436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.895517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.895687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.895768 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.895922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.896971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.897139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.897219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.897379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.897459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.897613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.897693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.897849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.897932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.898122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.898263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.898361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.898425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.898578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.898661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.898825 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.898906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.899073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.899152 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.899306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.899386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.899535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.899615 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.899766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.899852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.900011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.900093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.900247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.900326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.900484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.900596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.901302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.901395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.901555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.901637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.901807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.901888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.902080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.902165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.902321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.902403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.902553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.902634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.902791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.902874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.903980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.904069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.904212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.904294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.904459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.904538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.904705 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.904787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.904938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.905019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.905184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.905264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.905429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.905517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.905661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.905742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.905899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.906953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.907101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.907190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.907338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.907419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.907575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.907663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.907821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.907902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.908055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.908142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.908286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.908376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.908535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.908616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.908781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.908861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.909975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.910060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.910222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.910357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.910464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.910595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.910699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.910847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.910928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.911099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.911316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.911407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.911560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.911642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.911789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.911869 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.912982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.913062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.913226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.913307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.913469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.913557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.913703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.913783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.913949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.914083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.914202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.914297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.914451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.914534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.914691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.914772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.914928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.915957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.916113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.916193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.916380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.916468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.916631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.916712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.916881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.916961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.917117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.917209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.917355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.917438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.917596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.917677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.917844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.917931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.918112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.918195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.918350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.918431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.918589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.918683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.918832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.918913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.919076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.919155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.919316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.919406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.919554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.919634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.919798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] resource.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.919877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.920047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.920135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.920286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.920367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.920527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.920607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.920763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.920852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] role.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] role.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.921984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.922067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.922234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] role.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.922318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.922482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.922562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] role.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.922717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.922796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.922967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.923049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.923214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.923295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.923460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.923541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.923707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.923791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.923941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.924998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.925170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.925314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.925420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.925551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.925675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.925803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.925925 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.926086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.926336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.926416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.926576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.926655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.926815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.926897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.927070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.927151 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.927319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.927407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.927557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.927638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.927790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.927872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.928979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.929060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.929217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.929298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.929451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.929539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.929683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.929765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.929920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] token.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.930997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.931154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.931238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.931390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.931470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.931633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.931721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.931901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.931981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.932151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.932231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.932387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.932476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.932628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.932710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.932863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.932944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.933110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.933199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.933348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.933427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.933578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.933659 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.933819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.933907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.934092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.934175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.934346 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.934427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.934581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.934672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.934830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.934912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.935095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.935176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.935343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.935423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.connection = **** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.935580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.935666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.935811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.935895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.936049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.936130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.936288 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.936369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.936534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.936617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.936777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.936857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937100 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.937999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.938085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.938237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.938319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.938480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.938562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.938716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.938800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.938874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 11:55:00.938948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.939182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.939426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.939664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:55:00.939837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 11:55:00.969139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:00.969329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:00.969417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:00.969566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:00.969652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:00.969797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:00.978091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:00.978496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.006504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.006665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.006747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.006824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.060736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.061137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.110007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.110247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.110927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.111164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.176668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.176896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.177988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.178182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.202054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.202286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.202516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.202603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.202739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.202824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.202957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.203042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.203174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.203259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.203390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.203476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.203603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.203820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.214690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.215017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.227152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.227383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.227607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.227738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.227839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.227976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.228062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.228206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.228291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.228432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.228525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.228681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.228909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.229128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80343) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 30 11:55:01.246171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.246382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 30 11:55:01.246717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.246802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.246909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 30 11:55:01.247020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 30 11:55:01.247175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.247259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.247436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.247520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 30 11:55:01.247692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.247776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.247950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.248035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.248207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.248506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.259033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.259264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.259528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.259741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.259826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.260589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.260861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.261142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.268494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.269370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.271857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.272131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.272409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.272685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.272769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.272965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.273050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.273281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.273364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.273567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.273651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.273854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.273937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.274158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.274243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.274440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.274522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.274706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.274798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.275044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.275336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.275636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.301434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.302500 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.303183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.303462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.304238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.304518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.309797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.310123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.310405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.310489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.310718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.310999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.317758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.318073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.318447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.318728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.323221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.323621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.323874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.323960 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.324173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.324257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.324447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.324872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.324985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.325071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.325254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.325338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.325521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.325607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.325871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.326167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.344092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.344368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.344800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.345079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.348978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.349719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.352633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.352925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.353444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.353766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.357924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.358788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.361513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.362406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.366575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.366872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.367153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.367433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.367518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.367710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.367795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.367986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.368124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.368315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.368596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.368876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.388127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.388408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.388673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.388945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.389029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.389238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.389508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.389787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.396933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.397782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.398684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.398956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.399546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.399826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.402024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.402306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.402585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.402865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.402949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.403165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.403250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.403473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.403755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.404052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.416653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.416928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.417204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.417482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.417612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.417760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.417891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.418073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.418196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.418357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.418480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.418771 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.419048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.419323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.437049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.438065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.440335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.441333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.443688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.444694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.445295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.446347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.446975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.447251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.448081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.448546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.448827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.449110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.455781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.456887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.457405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.458549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.460616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.460903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.461187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.461456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.461764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.462079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.462365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.462644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.470637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.470922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.471314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.471844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.472153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.472522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.479760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.480034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.480311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.480586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.480855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.481129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.481264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80343) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 30 11:55:01.481407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.481535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.481684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.481817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.481970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.482117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.482245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.482392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.482512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.482695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.482778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.482973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.483064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.483249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.483331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.483528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.483798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.484070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.484340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.484621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.484882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80343) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 30 11:55:01.521610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563733c629c0 pid: 80344 (default app) May 30 11:55:01.523380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563733c629c0 pid: 80343 (default app) May 30 11:55:01.524834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec043-f92d-47ad-a672-0f81a09320b0 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:01.525131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec043-f92d-47ad-a672-0f81a09320b0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:01.525413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec043-f92d-47ad-a672-0f81a09320b0 None None] PATH_INFO: `/v3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:01.529694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Mon May 30 11:55:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:10.618492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0951-a6a2-49fd-93a0-62fd765eae6a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:10.619646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0951-a6a2-49fd-93a0-62fd765eae6a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:10.619646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0951-a6a2-49fd-93a0-62fd765eae6a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:10.623989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:10.629060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:10.629444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:10.629623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:10.697391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: INFO dbcounter [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] Registered counter for database keystone May 30 11:55:10.718600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG oslo_db.sqlalchemy.engines [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:10.724686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writer thread running {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:11.003449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG passlib.handlers.bcrypt [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80344) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 30 11:55:11.003881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG passlib.handlers.bcrypt [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80344) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 30 11:55:11.058998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:11.060611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:11.183085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 555 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 30 11:55:11.358959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab0951-a6a2-49fd-93a0-62fd765eae6a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:11.427588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: INFO dbcounter [None req-49ab0951-a6a2-49fd-93a0-62fd765eae6a None None] Registered counter for database keystone May 30 11:55:11.446588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG oslo_db.sqlalchemy.engines [None req-49ab0951-a6a2-49fd-93a0-62fd765eae6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:55:11.454684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writer thread running {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:55:11.681836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab0951-a6a2-49fd-93a0-62fd765eae6a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:11.686073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fdef1-ced6-4589-b5f2-cb1acb9e3dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:11.686740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fdef1-ced6-4589-b5f2-cb1acb9e3dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:11.687033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fdef1-ced6-4589-b5f2-cb1acb9e3dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:11.687318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fdef1-ced6-4589-b5f2-cb1acb9e3dd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:11.695345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fdef1-ced6-4589-b5f2-cb1acb9e3dd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:11.749258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cf5fdef1-ced6-4589-b5f2-cb1acb9e3dd7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 30 11:55:11.749486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fdef1-ced6-4589-b5f2-cb1acb9e3dd7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:11.760097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 30 11:55:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 30 11:55:11.766251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:11.780581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5425ebf-fa8b-403a-b04d-c52a52b7e4d5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:11.785015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf021d0f-5eee-4308-88bf-a19d0127d676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:11.786164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf021d0f-5eee-4308-88bf-a19d0127d676 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:11.786451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf021d0f-5eee-4308-88bf-a19d0127d676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:11.786726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf021d0f-5eee-4308-88bf-a19d0127d676 admin admin] PATH_INFO: `/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:11.788226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf021d0f-5eee-4308-88bf-a19d0127d676 admin admin] RBAC: Authorizing `identity:get_project(project_id=9afd60ec71934d3cbf3f12a53b6e9a17)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:11.839832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cf021d0f-5eee-4308-88bf-a19d0127d676 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 30 11:55:11.840183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf021d0f-5eee-4308-88bf-a19d0127d676 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:11.844760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Mon May 30 11:55:11 2022] GET /identity/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:14.031269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364170-4f9d-4881-8ad2-29e57b77bf25 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:14.031756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364170-4f9d-4881-8ad2-29e57b77bf25 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:14.031756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364170-4f9d-4881-8ad2-29e57b77bf25 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:14.035867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:14.041952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e71f2-51e6-461a-9ac5-ffd65cf71397 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:14.042459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e71f2-51e6-461a-9ac5-ffd65cf71397 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:14.042562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e71f2-51e6-461a-9ac5-ffd65cf71397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:14.061031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7b2e71f2-51e6-461a-9ac5-ffd65cf71397 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:14.062584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b2e71f2-51e6-461a-9ac5-ffd65cf71397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:14.070345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 30 11:55:14.093067 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35364170-4f9d-4881-8ad2-29e57b77bf25 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:14.105694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35364170-4f9d-4881-8ad2-29e57b77bf25 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:14.109815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d091575-fa45-482f-b06f-a7ee3b504c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:14.110473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d091575-fa45-482f-b06f-a7ee3b504c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:14.110765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d091575-fa45-482f-b06f-a7ee3b504c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:14.111047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d091575-fa45-482f-b06f-a7ee3b504c77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:14.118639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d091575-fa45-482f-b06f-a7ee3b504c77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:14.120415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d091575-fa45-482f-b06f-a7ee3b504c77 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:14.129204 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 30 11:55:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 11:55:14.134563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e71f2-51e6-461a-9ac5-ffd65cf71397 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:14.143434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e71f2-51e6-461a-9ac5-ffd65cf71397 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:14.147841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd15cd-d136-43f3-8d20-ff8605f64f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:14.148697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd15cd-d136-43f3-8d20-ff8605f64f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:14.148988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd15cd-d136-43f3-8d20-ff8605f64f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:14.149274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd15cd-d136-43f3-8d20-ff8605f64f44 admin admin] PATH_INFO: `/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:14.151166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd15cd-d136-43f3-8d20-ff8605f64f44 admin admin] RBAC: Authorizing `identity:get_user(user_id=9fbe87ad0d3c4f67b20c51a5a999566b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:14.153040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd15cd-d136-43f3-8d20-ff8605f64f44 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:14.154606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Mon May 30 11:55:14 2022] GET /identity/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:16.451332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5aacf-e490-4eb1-8725-b9f0590d9753 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.451865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5aacf-e490-4eb1-8725-b9f0590d9753 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.451949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5aacf-e490-4eb1-8725-b9f0590d9753 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.453250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:16.458430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3849a5-1eda-4a9d-aed0-a889620539c8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.458850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90ee1f-1c30-430b-9544-fc1018e91cc6 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.458945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3849a5-1eda-4a9d-aed0-a889620539c8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.459027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90ee1f-1c30-430b-9544-fc1018e91cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.459110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3849a5-1eda-4a9d-aed0-a889620539c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.459195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90ee1f-1c30-430b-9544-fc1018e91cc6 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.460390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:16.465515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.465813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.466153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.476016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8d3849a5-1eda-4a9d-aed0-a889620539c8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:16.477221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8d3849a5-1eda-4a9d-aed0-a889620539c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:16.507046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG passlib.handlers.bcrypt [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80343) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 30 11:55:16.507469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG passlib.handlers.bcrypt [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80343) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 30 11:55:16.553979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:16.555565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:16.557173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:16.581022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3849a5-1eda-4a9d-aed0-a889620539c8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.604273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:16.656491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:16.678548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.683808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3849a5-1eda-4a9d-aed0-a889620539c8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:16.717055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d868-36d1-448b-8862-f2cff8300323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:16.717785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d868-36d1-448b-8862-f2cff8300323 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.718108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d868-36d1-448b-8862-f2cff8300323 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.718394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6d868-36d1-448b-8862-f2cff8300323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.730017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6d868-36d1-448b-8862-f2cff8300323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ebe6d868-36d1-448b-8862-f2cff8300323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:16.741306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:16.742475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:16.744086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:55:16.748825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d868-36d1-448b-8862-f2cff8300323 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.781781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406d188-2688-43b9-8bfc-554eedca736b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:16.784465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:16.819657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3e3dd-7e6f-44bc-9d5d-ca28a181fd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:16.820563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3e3dd-7e6f-44bc-9d5d-ca28a181fd28 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.820856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3e3dd-7e6f-44bc-9d5d-ca28a181fd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.821136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3e3dd-7e6f-44bc-9d5d-ca28a181fd28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.829876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:16.847427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6d868-36d1-448b-8862-f2cff8300323 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:16.881693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:16.882388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:16.882858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:16.883143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:16.883892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:16.884235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:16.885642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:16.887858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3e3dd-7e6f-44bc-9d5d-ca28a181fd28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:16.889385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3e3dd-7e6f-44bc-9d5d-ca28a181fd28 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:16.898608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:16.904386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.989090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:55:16.994494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3e3dd-7e6f-44bc-9d5d-ca28a181fd28 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:16.997081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:17.001256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b23e-1f25-4f97-9e89-0ca437837fc0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:17.035257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a37e-db3a-4631-a05c-e7882d37daf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:17.036129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a37e-db3a-4631-a05c-e7882d37daf4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:17.036416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a37e-db3a-4631-a05c-e7882d37daf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:17.036697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a37e-db3a-4631-a05c-e7882d37daf4 None admin] PATH_INFO: `/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:17.037901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a37e-db3a-4631-a05c-e7882d37daf4 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbe87ad0d3c4f67b20c51a5a999566b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:17.039394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a37e-db3a-4631-a05c-e7882d37daf4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:17.041595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:17.046865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a37e-db3a-4631-a05c-e7882d37daf4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:17.062079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:17.092369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3e3dd-7e6f-44bc-9d5d-ca28a181fd28 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:17.125366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:17.126180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:17.126466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:17.126742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:17.144576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:17.146084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:17.146189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a37e-db3a-4631-a05c-e7882d37daf4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:55:17.167725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:17.168531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:17.169321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:55:17.169321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:55:17.169321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:55:17.169321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:17.169321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:55:17.174803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:17.184279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f09c7-254d-4ec3-b0be-5bf448319da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:17.185069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f09c7-254d-4ec3-b0be-5bf448319da8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:17.185358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f09c7-254d-4ec3-b0be-5bf448319da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:17.185634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f09c7-254d-4ec3-b0be-5bf448319da8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:17.186824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f09c7-254d-4ec3-b0be-5bf448319da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:17.188286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f09c7-254d-4ec3-b0be-5bf448319da8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:17.189865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:17.195447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f09c7-254d-4ec3-b0be-5bf448319da8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:17.230964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:17.273502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51b78-cb9a-44e2-9b71-e691abda5311 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:17.273907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:17.292803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f09c7-254d-4ec3-b0be-5bf448319da8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:17.306825 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414438c-a49a-4d4e-88a2-f43f53f31f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:17.307853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414438c-a49a-4d4e-88a2-f43f53f31f4f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:17.308296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414438c-a49a-4d4e-88a2-f43f53f31f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:17.308582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414438c-a49a-4d4e-88a2-f43f53f31f4f None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:17.309318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414438c-a49a-4d4e-88a2-f43f53f31f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:17.309629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414438c-a49a-4d4e-88a2-f43f53f31f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:17.311076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414438c-a49a-4d4e-88a2-f43f53f31f4f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:17.327364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715cb09-42db-4ee7-85e2-d2f9494e6a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:17.328021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cb09-42db-4ee7-85e2-d2f9494e6a7c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:17.328311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cb09-42db-4ee7-85e2-d2f9494e6a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:17.328594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cb09-42db-4ee7-85e2-d2f9494e6a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:17.328784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:17.329437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715cb09-42db-4ee7-85e2-d2f9494e6a7c None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.domain.id=default, user.id=9fbe87ad0d3c4f67b20c51a5a999566b) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:17.329754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715cb09-42db-4ee7-85e2-d2f9494e6a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:17.331262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715cb09-42db-4ee7-85e2-d2f9494e6a7c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:17.339155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 30 11:55:17 2022] GET /identity/v3/role_assignments?user.id=9fbe87ad0d3c4f67b20c51a5a999566b&scope.domain.id=default&role.id=f3f138e4021a4b7dada39089dd427266 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:20.203768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f79b6-6930-4edc-897c-7f6d54af314d None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.204609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f79b6-6930-4edc-897c-7f6d54af314d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.205037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f79b6-6930-4edc-897c-7f6d54af314d None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.206613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:20.212229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166a63-c479-44ab-8513-e86eab818135 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.212999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166a63-c479-44ab-8513-e86eab818135 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.213618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166a63-c479-44ab-8513-e86eab818135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.234918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-69166a63-c479-44ab-8513-e86eab818135 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:20.236351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-69166a63-c479-44ab-8513-e86eab818135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:20.331439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:20.364456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f79b6-6930-4edc-897c-7f6d54af314d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:20.432699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5304c-a970-47d0-82a0-ea4e94c2b193 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.433233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5304c-a970-47d0-82a0-ea4e94c2b193 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.433672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5304c-a970-47d0-82a0-ea4e94c2b193 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.435209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:20.440278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ea24f-e54d-44b5-b9aa-b8d17cee1b78 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.440726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ea24f-e54d-44b5-b9aa-b8d17cee1b78 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.441147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ea24f-e54d-44b5-b9aa-b8d17cee1b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.468299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-573ea24f-e54d-44b5-b9aa-b8d17cee1b78 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:20.474876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-573ea24f-e54d-44b5-b9aa-b8d17cee1b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:20.563275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f79b6-6930-4edc-897c-7f6d54af314d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:20.602331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:20.625280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:20.635601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc6d4-d94e-4ba9-81dd-4c07bfaecc99 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.635897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc6d4-d94e-4ba9-81dd-4c07bfaecc99 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.636173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc6d4-d94e-4ba9-81dd-4c07bfaecc99 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.637533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 15/26] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:20.637747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a4d11-632f-47b7-9e6e-6c47c3622e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:20.638474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a4d11-632f-47b7-9e6e-6c47c3622e2f None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.638770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a4d11-632f-47b7-9e6e-6c47c3622e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.639050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a4d11-632f-47b7-9e6e-6c47c3622e2f None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.639892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a4d11-632f-47b7-9e6e-6c47c3622e2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:20.641316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a4d11-632f-47b7-9e6e-6c47c3622e2f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:20.649402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2e19-c1da-418f-acd0-7066f04f6fcd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.650305 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2e19-c1da-418f-acd0-7066f04f6fcd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.650593 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2e19-c1da-418f-acd0-7066f04f6fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.664545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:20.676416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bfab2e19-c1da-418f-acd0-7066f04f6fcd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:20.677637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bfab2e19-c1da-418f-acd0-7066f04f6fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:20.757738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 16/27] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:20.758389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2e19-c1da-418f-acd0-7066f04f6fcd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:20.883894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2e19-c1da-418f-acd0-7066f04f6fcd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:20.899163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 12/28] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 30 11:55:20 2022] POST /identity/v3/roles => generated 219 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:20.901141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cde03a-e56f-4920-9f9d-0db8a41ba8db None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.901444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cde03a-e56f-4920-9f9d-0db8a41ba8db None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.901738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cde03a-e56f-4920-9f9d-0db8a41ba8db None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.903071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 13/29] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:20.903812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cde03a-e56f-4920-9f9d-0db8a41ba8db None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:20.939040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1aaf6-26a0-4b43-a65e-492fdb865d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:20.939736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1aaf6-26a0-4b43-a65e-492fdb865d25 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:20.940025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1aaf6-26a0-4b43-a65e-492fdb865d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:20.940305 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1aaf6-26a0-4b43-a65e-492fdb865d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:20.941089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1aaf6-26a0-4b43-a65e-492fdb865d25 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:20.946527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1aaf6-26a0-4b43-a65e-492fdb865d25 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:20.949834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:21.075892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cde03a-e56f-4920-9f9d-0db8a41ba8db None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:21.150913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 17/30] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 30 11:55:20 2022] POST /identity/v3/roles => generated 225 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:21.152756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feac4d-6d45-4bbd-ad2c-e3836b817b1c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.153132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feac4d-6d45-4bbd-ad2c-e3836b817b1c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.153483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feac4d-6d45-4bbd-ad2c-e3836b817b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.155500 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37900-21e6-4324-8dd8-eea07ebf4815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:21.156657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37900-21e6-4324-8dd8-eea07ebf4815 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.157158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37900-21e6-4324-8dd8-eea07ebf4815 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.157637 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37900-21e6-4324-8dd8-eea07ebf4815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.175407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f4feac4d-6d45-4bbd-ad2c-e3836b817b1c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:21.175960 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd37900-21e6-4324-8dd8-eea07ebf4815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:21.177071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f4feac4d-6d45-4bbd-ad2c-e3836b817b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-1fd37900-21e6-4324-8dd8-eea07ebf4815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:21.186452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:21.187370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:21.188148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:21.190694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 14/31] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:21.192245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403801d3-89b8-49c0-b790-ab1a3508279b None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.192695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403801d3-89b8-49c0-b790-ab1a3508279b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.193124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403801d3-89b8-49c0-b790-ab1a3508279b None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.194568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 15/32] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:21.201296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403801d3-89b8-49c0-b790-ab1a3508279b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:21.261282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:21.284739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 18/33] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:21.286899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3d4bb-34a9-45ff-9d9b-92c86c29d62c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.287446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3d4bb-34a9-45ff-9d9b-92c86c29d62c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.287957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3d4bb-34a9-45ff-9d9b-92c86c29d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.310420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fdc3d4bb-34a9-45ff-9d9b-92c86c29d62c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:21.311999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fdc3d4bb-34a9-45ff-9d9b-92c86c29d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:21.369805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403801d3-89b8-49c0-b790-ab1a3508279b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:21.408042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 19/34] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:21.413638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3d4bb-34a9-45ff-9d9b-92c86c29d62c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:21.417150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:21.417840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.418271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.418653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.419626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:21.419897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:21.421751 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:21.436708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 16/35] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:21.443256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:21.471897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:21.531003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3d4bb-34a9-45ff-9d9b-92c86c29d62c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:21.550138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:21.553583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7316c-487d-4db5-b8fa-a1caf70f292c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:21.565427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9913-4518-4d83-b9c2-5a1bd1066f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:21.566260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9913-4518-4d83-b9c2-5a1bd1066f17 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.566553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9913-4518-4d83-b9c2-5a1bd1066f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.566839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9913-4518-4d83-b9c2-5a1bd1066f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.578043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd9913-4518-4d83-b9c2-5a1bd1066f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:21.579673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd9913-4518-4d83-b9c2-5a1bd1066f17 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:21.588187 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55873fa-2d84-4276-9e05-6d2f184c7f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:21.589061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55873fa-2d84-4276-9e05-6d2f184c7f3c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.589348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55873fa-2d84-4276-9e05-6d2f184c7f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.589627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55873fa-2d84-4276-9e05-6d2f184c7f3c None admin] PATH_INFO: `/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.591357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55873fa-2d84-4276-9e05-6d2f184c7f3c None admin] RBAC: Authorizing `identity:get_user(user_id=9fbe87ad0d3c4f67b20c51a5a999566b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:21.592808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55873fa-2d84-4276-9e05-6d2f184c7f3c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:21.594678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 17/36] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:21 2022] GET /identity/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:21.595320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55873fa-2d84-4276-9e05-6d2f184c7f3c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5bbd9913-4518-4d83-b9c2-5a1bd1066f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:55:21.597492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:21.598384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 20/37] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d570ab-5df0-4e0e-a237-1ffbaaca3f29 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d570ab-5df0-4e0e-a237-1ffbaaca3f29 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d570ab-5df0-4e0e-a237-1ffbaaca3f29 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.604147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 21/38] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:21.604713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d570ab-5df0-4e0e-a237-1ffbaaca3f29 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:21.695099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55873fa-2d84-4276-9e05-6d2f184c7f3c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:21.706303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d570ab-5df0-4e0e-a237-1ffbaaca3f29 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:21.713094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:21.728903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb83f7-09f5-4c14-8969-47be5983db9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:21.731947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb83f7-09f5-4c14-8969-47be5983db9a None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.731947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb83f7-09f5-4c14-8969-47be5983db9a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.731947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb83f7-09f5-4c14-8969-47be5983db9a None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.731947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb83f7-09f5-4c14-8969-47be5983db9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:21.732323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb83f7-09f5-4c14-8969-47be5983db9a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:21.740226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e0d4-c5b5-4044-862b-3ca911498c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:21.741026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e0d4-c5b5-4044-862b-3ca911498c4f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.741321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e0d4-c5b5-4044-862b-3ca911498c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.741608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e0d4-c5b5-4044-862b-3ca911498c4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.742876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e0d4-c5b5-4044-862b-3ca911498c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:21.744946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e0d4-c5b5-4044-862b-3ca911498c4f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:21.746663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 22/39] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:21.747391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e0d4-c5b5-4044-862b-3ca911498c4f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:21.825992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 18/40] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 30 11:55:21 2022] POST /identity/v3/roles => generated 223 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:21.825992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7903e-17a5-4351-be46-fb9139679210 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.825992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7903e-17a5-4351-be46-fb9139679210 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.825992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7903e-17a5-4351-be46-fb9139679210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.844058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d3f7903e-17a5-4351-be46-fb9139679210 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:21.846036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d3f7903e-17a5-4351-be46-fb9139679210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:21.855340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e0d4-c5b5-4044-862b-3ca911498c4f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:21.870882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:21.896567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:21.897406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:21.897704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:21.898016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:21.898802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:21.899121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:21.900671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:21.920563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 23/41] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:21.925985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:21.927602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 19/42] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:21.928663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7903e-17a5-4351-be46-fb9139679210 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:21.969204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:22.043437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1c05-6eda-4945-a574-f51fe40f8e02 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:22.057019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7903e-17a5-4351-be46-fb9139679210 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:22.079642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b2c20-b285-48f6-b91b-853093d1169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:22.080529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2c20-b285-48f6-b91b-853093d1169b None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:22.080821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2c20-b285-48f6-b91b-853093d1169b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:22.081107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2c20-b285-48f6-b91b-853093d1169b None admin] PATH_INFO: `/v3/domains/default/users/9fbe87ad0d3c4f67b20c51a5a999566b/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:22.083218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b2c20-b285-48f6-b91b-853093d1169b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9fbe87ad0d3c4f67b20c51a5a999566b, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:22.084687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b2c20-b285-48f6-b91b-853093d1169b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:22.094038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e462-0ddd-453a-be54-fe8e4f806d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:22.094718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e462-0ddd-453a-be54-fe8e4f806d79 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:22.095016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e462-0ddd-453a-be54-fe8e4f806d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:22.095311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e462-0ddd-453a-be54-fe8e4f806d79 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:22.096023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e462-0ddd-453a-be54-fe8e4f806d79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:22.097533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e462-0ddd-453a-be54-fe8e4f806d79 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:22.156273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 24/43] 10.222.0.48 () {58 vars in 1361 bytes} [Mon May 30 11:55:21 2022] PUT /identity/v3/domains/default/users/9fbe87ad0d3c4f67b20c51a5a999566b/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:22.157143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b2c20-b285-48f6-b91b-853093d1169b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:22.188013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 20/44] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:55:21 2022] POST /identity/v3/projects => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:22.272375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:22.281667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b2c20-b285-48f6-b91b-853093d1169b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:22.322230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443df85d-a318-4b37-9135-0ced9826492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:22.323062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443df85d-a318-4b37-9135-0ced9826492d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:22.323356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443df85d-a318-4b37-9135-0ced9826492d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:22.323641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443df85d-a318-4b37-9135-0ced9826492d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:22.325166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443df85d-a318-4b37-9135-0ced9826492d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:22.326803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443df85d-a318-4b37-9135-0ced9826492d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:22.328747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 25/45] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:22.334503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e462-0ddd-453a-be54-fe8e4f806d79 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:22.348275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:22.449868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e462-0ddd-453a-be54-fe8e4f806d79 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:22.485831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ba252-b5b7-4d1b-8132-990fad31e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:22.486539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba252-b5b7-4d1b-8132-990fad31e250 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:22.486834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba252-b5b7-4d1b-8132-990fad31e250 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:22.487122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba252-b5b7-4d1b-8132-990fad31e250 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:22.487843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ba252-b5b7-4d1b-8132-990fad31e250 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:22.489321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ba252-b5b7-4d1b-8132-990fad31e250 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:22.585728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 21/46] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:55:22 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:24.404985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2b8e2-deff-413a-af60-04ae0adab2d5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:24.405496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2b8e2-deff-413a-af60-04ae0adab2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:24.405579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2b8e2-deff-413a-af60-04ae0adab2d5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:24.407001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 26/47] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:24.412273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab19f46-6226-40ca-919c-171b500287de None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:24.412689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab19f46-6226-40ca-919c-171b500287de None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:24.412989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab19f46-6226-40ca-919c-171b500287de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:24.430811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7ab19f46-6226-40ca-919c-171b500287de None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:24.432011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7ab19f46-6226-40ca-919c-171b500287de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:24.488251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:24.498922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 22/48] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:24.522670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2b8e2-deff-413a-af60-04ae0adab2d5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:24.628369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2b8e2-deff-413a-af60-04ae0adab2d5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:24.660721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88bb89-fc13-4285-aff9-dbfe47beb9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:24.661441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88bb89-fc13-4285-aff9-dbfe47beb9bd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:24.661729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88bb89-fc13-4285-aff9-dbfe47beb9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:24.662039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88bb89-fc13-4285-aff9-dbfe47beb9bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:24.672389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88bb89-fc13-4285-aff9-dbfe47beb9bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7f88bb89-fc13-4285-aff9-dbfe47beb9bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:24.680044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:24.680918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:24.681656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 27/49] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:24.687175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab19f46-6226-40ca-919c-171b500287de None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:24.786286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab19f46-6226-40ca-919c-171b500287de None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:24.818575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa83f7-ddfc-448c-ae5f-66adc617436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:24.819248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa83f7-ddfc-448c-ae5f-66adc617436a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:24.819540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa83f7-ddfc-448c-ae5f-66adc617436a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:24.819827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa83f7-ddfc-448c-ae5f-66adc617436a None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:24.820578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa83f7-ddfc-448c-ae5f-66adc617436a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:24.820892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa83f7-ddfc-448c-ae5f-66adc617436a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:24.822805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa83f7-ddfc-448c-ae5f-66adc617436a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:24.830999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 23/50] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:24.836533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88bb89-fc13-4285-aff9-dbfe47beb9bd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:24.862001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:24.884332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4514e-98d5-4ed0-9fe7-36b692af0973 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:24.884632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4514e-98d5-4ed0-9fe7-36b692af0973 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:24.884920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4514e-98d5-4ed0-9fe7-36b692af0973 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:24.886440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 24/51] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:24.891591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18a11-cb5d-444d-9cde-ab01012ec8b0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:24.891889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18a11-cb5d-444d-9cde-ab01012ec8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:24.892176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18a11-cb5d-444d-9cde-ab01012ec8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:24.909310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-34c18a11-cb5d-444d-9cde-ab01012ec8b0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:24.910539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-34c18a11-cb5d-444d-9cde-ab01012ec8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:24.936294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88bb89-fc13-4285-aff9-dbfe47beb9bd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:24.957494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:24.969555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe782e1c-e352-4f3c-9eb1-ac618a593a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:24.970936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782e1c-e352-4f3c-9eb1-ac618a593a51 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:24.970936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782e1c-e352-4f3c-9eb1-ac618a593a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:24.971217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782e1c-e352-4f3c-9eb1-ac618a593a51 None admin] PATH_INFO: `/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:24.972254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe782e1c-e352-4f3c-9eb1-ac618a593a51 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbe87ad0d3c4f67b20c51a5a999566b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:24.973719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe782e1c-e352-4f3c-9eb1-ac618a593a51 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:24.975386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:24 2022] GET /identity/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:24.978293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 25/53] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:24.980860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe782e1c-e352-4f3c-9eb1-ac618a593a51 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:25.001137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18a11-cb5d-444d-9cde-ab01012ec8b0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:25.068728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:25.079010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe782e1c-e352-4f3c-9eb1-ac618a593a51 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:25.098648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18a11-cb5d-444d-9cde-ab01012ec8b0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:25.246252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b683c6-59da-453e-bf39-0c63a5ab8a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:25.246252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b683c6-59da-453e-bf39-0c63a5ab8a59 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:25.246252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b683c6-59da-453e-bf39-0c63a5ab8a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:25.246252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b683c6-59da-453e-bf39-0c63a5ab8a59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:25.246658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b683c6-59da-453e-bf39-0c63a5ab8a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:25.246658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b683c6-59da-453e-bf39-0c63a5ab8a59 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:25.246658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 29/54] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:25.246658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b683c6-59da-453e-bf39-0c63a5ab8a59 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:25.246948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba8701-b5f7-48b7-808a-d4c94fcc6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:25.246948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8701-b5f7-48b7-808a-d4c94fcc6396 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:25.246948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8701-b5f7-48b7-808a-d4c94fcc6396 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:25.246948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8701-b5f7-48b7-808a-d4c94fcc6396 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:25.247244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba8701-b5f7-48b7-808a-d4c94fcc6396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:25.247244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba8701-b5f7-48b7-808a-d4c94fcc6396 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:25.247244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:25.247244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba8701-b5f7-48b7-808a-d4c94fcc6396 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:25.247244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:25.247545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b683c6-59da-453e-bf39-0c63a5ab8a59 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:25.247616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba8701-b5f7-48b7-808a-d4c94fcc6396 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:25.258592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad17b87-493b-4d0f-9942-e537ea5f6b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:25.259776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17b87-493b-4d0f-9942-e537ea5f6b1f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:25.260064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17b87-493b-4d0f-9942-e537ea5f6b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:25.260341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17b87-493b-4d0f-9942-e537ea5f6b1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:25.261173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad17b87-493b-4d0f-9942-e537ea5f6b1f None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.domain.id=default, user.id=9fbe87ad0d3c4f67b20c51a5a999566b) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:25.261485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad17b87-493b-4d0f-9942-e537ea5f6b1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:25.262998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad17b87-493b-4d0f-9942-e537ea5f6b1f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:25.268695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 30 11:55:25 2022] GET /identity/v3/role_assignments?user.id=9fbe87ad0d3c4f67b20c51a5a999566b&scope.domain.id=default&role.id=f3f138e4021a4b7dada39089dd427266 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:25.280943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b1280-0390-40c2-af29-e41eb00c43e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:25.283981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b1280-0390-40c2-af29-e41eb00c43e9 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:25.283981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b1280-0390-40c2-af29-e41eb00c43e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:25.283981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b1280-0390-40c2-af29-e41eb00c43e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:25.283981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b1280-0390-40c2-af29-e41eb00c43e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:25.284514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b1280-0390-40c2-af29-e41eb00c43e9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:25.437079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 27/57] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 30 11:55:25 2022] POST /identity/v3/projects => generated 298 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:55:27.654076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562262-0277-452b-96fd-c2a2a07092df None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:27.654609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562262-0277-452b-96fd-c2a2a07092df None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:27.654706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562262-0277-452b-96fd-c2a2a07092df None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:27.656014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:27.661267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a517-6c9b-49e1-8e03-76bf06d91ce9 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:27.661673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a517-6c9b-49e1-8e03-76bf06d91ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:27.661838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a517-6c9b-49e1-8e03-76bf06d91ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:27.678312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4b98a517-6c9b-49e1-8e03-76bf06d91ce9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:27.679501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4b98a517-6c9b-49e1-8e03-76bf06d91ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:27.745070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:27.769290 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8562262-0277-452b-96fd-c2a2a07092df None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:27.793854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:27.869186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8562262-0277-452b-96fd-c2a2a07092df None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:27.900697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980723c3-d3b8-4146-9c5b-952e02f381f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:27.901481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980723c3-d3b8-4146-9c5b-952e02f381f9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:27.901771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980723c3-d3b8-4146-9c5b-952e02f381f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:27.902082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980723c3-d3b8-4146-9c5b-952e02f381f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:27.903254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980723c3-d3b8-4146-9c5b-952e02f381f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:27.904749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980723c3-d3b8-4146-9c5b-952e02f381f9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:27.906318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:27.911669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98a517-6c9b-49e1-8e03-76bf06d91ce9 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:27.941802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:28.007454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98a517-6c9b-49e1-8e03-76bf06d91ce9 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:28.041337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02d340-9a01-465a-a2b1-8435d8105806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:28.042024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d340-9a01-465a-a2b1-8435d8105806 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:28.042320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d340-9a01-465a-a2b1-8435d8105806 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:28.042623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d340-9a01-465a-a2b1-8435d8105806 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:28.043332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02d340-9a01-465a-a2b1-8435d8105806 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:28.044792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02d340-9a01-465a-a2b1-8435d8105806 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:28.138571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:55:27 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:31.303846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43be7-cb18-4ee2-bdc6-d5b12c3df820 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:31.304894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43be7-cb18-4ee2-bdc6-d5b12c3df820 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:31.305441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43be7-cb18-4ee2-bdc6-d5b12c3df820 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:31.307361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:31.312857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439714a-44a2-4647-8eb7-ac3db5533743 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:31.313824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439714a-44a2-4647-8eb7-ac3db5533743 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:31.314351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439714a-44a2-4647-8eb7-ac3db5533743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:31.339926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b439714a-44a2-4647-8eb7-ac3db5533743 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:31.341498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b439714a-44a2-4647-8eb7-ac3db5533743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:31.431916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 30/63] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:31.479446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43be7-cb18-4ee2-bdc6-d5b12c3df820 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:31.608745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:31.619427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43be7-cb18-4ee2-bdc6-d5b12c3df820 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:31.676381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d205b0e-6d16-4c7a-a825-e0e4726b83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:31.677572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205b0e-6d16-4c7a-a825-e0e4726b83da None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:31.678120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205b0e-6d16-4c7a-a825-e0e4726b83da None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:31.678615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205b0e-6d16-4c7a-a825-e0e4726b83da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:31.692514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d205b0e-6d16-4c7a-a825-e0e4726b83da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:31.701250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd8e6-2585-4492-8cc7-7110789792f3 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:31.701908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd8e6-2585-4492-8cc7-7110789792f3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:31.702463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dd8e6-2585-4492-8cc7-7110789792f3 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:31.704128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2d205b0e-6d16-4c7a-a825-e0e4726b83da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:31.708085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:31.708956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:31.709744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 34/65] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:31.712410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d205b0e-6d16-4c7a-a825-e0e4726b83da None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:31.713006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152df46e-c200-43e4-803a-99bd815cef02 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:31.713506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152df46e-c200-43e4-803a-99bd815cef02 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:31.714002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152df46e-c200-43e4-803a-99bd815cef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:31.751210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-152df46e-c200-43e4-803a-99bd815cef02 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:31.753990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-152df46e-c200-43e4-803a-99bd815cef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:31.790320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:31.866690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 32/66] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:31.869283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4227c7-44f9-4b7f-b421-1e184fffc69e None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:31.869584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4227c7-44f9-4b7f-b421-1e184fffc69e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:31.869873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4227c7-44f9-4b7f-b421-1e184fffc69e None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:31.871207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 33/67] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:31.871783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d205b0e-6d16-4c7a-a825-e0e4726b83da None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:31.876739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28e4a-0164-43fa-90e0-bdb96a7bdaa0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:31.877307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28e4a-0164-43fa-90e0-bdb96a7bdaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:31.877791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28e4a-0164-43fa-90e0-bdb96a7bdaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:31.895602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9af28e4a-0164-43fa-90e0-bdb96a7bdaa0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:31.897262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9af28e4a-0164-43fa-90e0-bdb96a7bdaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:31.909261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:31.910166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:31.910488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:31.910773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:31.911535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:31.911876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:31.913255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:31.922453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 35/68] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:31.923533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:31.940291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:31.982052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 34/69] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:31.983244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28e4a-0164-43fa-90e0-bdb96a7bdaa0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.051903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066ad66-6b88-4491-bb70-433c6ddf26e4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.087845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:32.091520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca9ae1-1e6f-4ddf-bbb4-a1bc6dc97569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.092332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca9ae1-1e6f-4ddf-bbb4-a1bc6dc97569 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.092627 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca9ae1-1e6f-4ddf-bbb4-a1bc6dc97569 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.092911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca9ae1-1e6f-4ddf-bbb4-a1bc6dc97569 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.105497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca9ae1-1e6f-4ddf-bbb4-a1bc6dc97569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:32.109782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28e4a-0164-43fa-90e0-bdb96a7bdaa0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-64ca9ae1-1e6f-4ddf-bbb4-a1bc6dc97569 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:32.113533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:32.114545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:32.115294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:32.115921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca9ae1-1e6f-4ddf-bbb4-a1bc6dc97569 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.148551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f237b-8246-4cfc-94b6-cee34d89616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.149381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f237b-8246-4cfc-94b6-cee34d89616c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.149672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f237b-8246-4cfc-94b6-cee34d89616c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.149952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f237b-8246-4cfc-94b6-cee34d89616c None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.165603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f237b-8246-4cfc-94b6-cee34d89616c None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:32.167118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f237b-8246-4cfc-94b6-cee34d89616c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:32.174014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:31 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:32.174014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397533-a38d-4db0-8cfc-ae6df4a35491 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.174014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397533-a38d-4db0-8cfc-ae6df4a35491 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.174014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397533-a38d-4db0-8cfc-ae6df4a35491 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.174014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 36/72] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:32.174014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397533-a38d-4db0-8cfc-ae6df4a35491 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.201992 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:32.235087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca9ae1-1e6f-4ddf-bbb4-a1bc6dc97569 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.272112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc674-cdba-4ac7-ba2e-c4645500beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.273024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc674-cdba-4ac7-ba2e-c4645500beff None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.273317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc674-cdba-4ac7-ba2e-c4645500beff None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.273605 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbc674-cdba-4ac7-ba2e-c4645500beff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.283475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397533-a38d-4db0-8cfc-ae6df4a35491 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.284234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbc674-cdba-4ac7-ba2e-c4645500beff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c0bbc674-cdba-4ac7-ba2e-c4645500beff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:32.292922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:32.293772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:32.294601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:32.295252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc674-cdba-4ac7-ba2e-c4645500beff None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.327023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1335c4-acbd-4f2a-a5bf-166c107cfc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.327700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1335c4-acbd-4f2a-a5bf-166c107cfc67 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.327993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1335c4-acbd-4f2a-a5bf-166c107cfc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.328276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1335c4-acbd-4f2a-a5bf-166c107cfc67 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.329028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1335c4-acbd-4f2a-a5bf-166c107cfc67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:32.329344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1335c4-acbd-4f2a-a5bf-166c107cfc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:32.330778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1335c4-acbd-4f2a-a5bf-166c107cfc67 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:32.332933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:32.339298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:32.346006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d4f1e-1dfd-4df7-9bd1-55fe4337480b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.346006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d4f1e-1dfd-4df7-9bd1-55fe4337480b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.346006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d4f1e-1dfd-4df7-9bd1-55fe4337480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.357189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d66d4f1e-1dfd-4df7-9bd1-55fe4337480b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:32.358436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d66d4f1e-1dfd-4df7-9bd1-55fe4337480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:32.401537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbc674-cdba-4ac7-ba2e-c4645500beff None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.423265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 38/75] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:32.424098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d4f1e-1dfd-4df7-9bd1-55fe4337480b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.434990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:32.435851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bd209-8b60-4df0-97f0-eb4dc1bcea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.436535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd209-8b60-4df0-97f0-eb4dc1bcea14 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.436824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd209-8b60-4df0-97f0-eb4dc1bcea14 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.437105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd209-8b60-4df0-97f0-eb4dc1bcea14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.503852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bd209-8b60-4df0-97f0-eb4dc1bcea14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:32.505312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bd209-8b60-4df0-97f0-eb4dc1bcea14 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:32.536231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d4f1e-1dfd-4df7-9bd1-55fe4337480b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.562567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:32.570174 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9fa1-b9ec-455e-b169-b40ed946c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.574668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9fa1-b9ec-455e-b169-b40ed946c685 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.574668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9fa1-b9ec-455e-b169-b40ed946c685 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.574668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9fa1-b9ec-455e-b169-b40ed946c685 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.574668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d9fa1-b9ec-455e-b169-b40ed946c685 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:32.574668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d9fa1-b9ec-455e-b169-b40ed946c685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:32.574668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d9fa1-b9ec-455e-b169-b40ed946c685 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:32.582051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 39/76] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:32.583246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcbbcb-be51-458e-a424-ccb22471cc7c None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.583610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcbbcb-be51-458e-a424-ccb22471cc7c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.583829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcbbcb-be51-458e-a424-ccb22471cc7c None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.585233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 40/77] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:32.585780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcbbcb-be51-458e-a424-ccb22471cc7c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.603456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 38/78] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:32.604306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bd209-8b60-4df0-97f0-eb4dc1bcea14 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.635757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:32.693887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcbbcb-be51-458e-a424-ccb22471cc7c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.705109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bd209-8b60-4df0-97f0-eb4dc1bcea14 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.726538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b2f9-c46a-4102-8620-75414047bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.727946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b2f9-c46a-4102-8620-75414047bd78 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.728237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b2f9-c46a-4102-8620-75414047bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.728519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b2f9-c46a-4102-8620-75414047bd78 None admin] PATH_INFO: `/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.729727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577b2f9-c46a-4102-8620-75414047bd78 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbe87ad0d3c4f67b20c51a5a999566b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:32.731226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577b2f9-c46a-4102-8620-75414047bd78 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:32.733034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 41/79] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:32.733640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b2f9-c46a-4102-8620-75414047bd78 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.741202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba47c7b-1492-40f0-abd9-3046b8f3dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.742039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47c7b-1492-40f0-abd9-3046b8f3dd2c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.742332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47c7b-1492-40f0-abd9-3046b8f3dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.742617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47c7b-1492-40f0-abd9-3046b8f3dd2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.752816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba47c7b-1492-40f0-abd9-3046b8f3dd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-eba47c7b-1492-40f0-abd9-3046b8f3dd2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:32.760509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:32.761421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:32.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 39/80] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:32.763090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21f2ec-877d-445a-a70b-d0989db27103 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.763319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21f2ec-877d-445a-a70b-d0989db27103 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.763593 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21f2ec-877d-445a-a70b-d0989db27103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.779587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2d21f2ec-877d-445a-a70b-d0989db27103 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:32.780769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2d21f2ec-877d-445a-a70b-d0989db27103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:32.798995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:32.840253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b2f9-c46a-4102-8620-75414047bd78 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.845446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 40/81] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:32.846214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21f2ec-877d-445a-a70b-d0989db27103 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.870671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:32.874882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190b662-b5f9-4f5b-b27d-0c4e33776dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.875757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b662-b5f9-4f5b-b27d-0c4e33776dae None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.876040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b662-b5f9-4f5b-b27d-0c4e33776dae None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.876320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190b662-b5f9-4f5b-b27d-0c4e33776dae None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.877505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190b662-b5f9-4f5b-b27d-0c4e33776dae None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:32.878988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190b662-b5f9-4f5b-b27d-0c4e33776dae None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:32.880618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:32.881376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190b662-b5f9-4f5b-b27d-0c4e33776dae None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:32.945066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21f2ec-877d-445a-a70b-d0989db27103 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.978603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190b662-b5f9-4f5b-b27d-0c4e33776dae None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:32.979065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01ba9f-fffb-4cf5-a313-f458227d92b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:32.979923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01ba9f-fffb-4cf5-a313-f458227d92b9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:32.980216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01ba9f-fffb-4cf5-a313-f458227d92b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:32.980490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01ba9f-fffb-4cf5-a313-f458227d92b9 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:32.981658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01ba9f-fffb-4cf5-a313-f458227d92b9 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:32.983151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01ba9f-fffb-4cf5-a313-f458227d92b9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:32.984832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 41/83] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:32.985582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01ba9f-fffb-4cf5-a313-f458227d92b9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.003322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.012076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24493139-81b6-46df-b4ff-e29242c55648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.012737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493139-81b6-46df-b4ff-e29242c55648 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.013031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493139-81b6-46df-b4ff-e29242c55648 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.013395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493139-81b6-46df-b4ff-e29242c55648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.077752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.081458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24493139-81b6-46df-b4ff-e29242c55648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.082992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24493139-81b6-46df-b4ff-e29242c55648 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.087362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01ba9f-fffb-4cf5-a313-f458227d92b9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.121038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.121693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.122007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.122295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.123036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:33.123341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.124714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.132528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 42/84] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:33.133838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.179877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:33.180879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24493139-81b6-46df-b4ff-e29242c55648 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.209002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.238336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e27504-d70c-4d42-97f9-598c3d04fc07 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.271213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6709e8-eeb7-469a-9e33-dc44096dc37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.272184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6709e8-eeb7-469a-9e33-dc44096dc37c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.272606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6709e8-eeb7-469a-9e33-dc44096dc37c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.272889 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6709e8-eeb7-469a-9e33-dc44096dc37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.274070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6709e8-eeb7-469a-9e33-dc44096dc37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.275528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6709e8-eeb7-469a-9e33-dc44096dc37c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.277301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 43/86] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:33.277884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6709e8-eeb7-469a-9e33-dc44096dc37c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.286243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24493139-81b6-46df-b4ff-e29242c55648 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.298784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.320498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1aa31e-660a-431e-9000-808463044477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.321216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aa31e-660a-431e-9000-808463044477 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.321505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aa31e-660a-431e-9000-808463044477 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.321788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aa31e-660a-431e-9000-808463044477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.377924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6709e8-eeb7-469a-9e33-dc44096dc37c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.388089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1aa31e-660a-431e-9000-808463044477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.389568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1aa31e-660a-431e-9000-808463044477 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.411482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.412132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.412425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.412710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.413542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] RBAC: Adding query filter params (role.id=ec78785738f441ec9be64e122e252506, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a, user.id=a941a87e586f4f72ade6be453d0effa2) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:33.413869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.415908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.416686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.421368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 44/87] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:33 2022] GET /identity/v3/role_assignments?user.id=a941a87e586f4f72ade6be453d0effa2&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=ec78785738f441ec9be64e122e252506 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:33.422804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.502128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 44/88] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:33.502128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1aa31e-660a-431e-9000-808463044477 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.524322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.543206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353313-2b80-43df-b1e8-2ac87b574342 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.579054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07092875-151d-4d8f-ae6a-7fabb55ba430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.579959 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092875-151d-4d8f-ae6a-7fabb55ba430 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.580247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092875-151d-4d8f-ae6a-7fabb55ba430 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.580530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092875-151d-4d8f-ae6a-7fabb55ba430 None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.581840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07092875-151d-4d8f-ae6a-7fabb55ba430 None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.583391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07092875-151d-4d8f-ae6a-7fabb55ba430 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.585096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 45/89] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:33 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:33.587504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07092875-151d-4d8f-ae6a-7fabb55ba430 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.612918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1aa31e-660a-431e-9000-808463044477 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.643330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.652403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463010-fad2-48b8-b616-cd6b65ed9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.653350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463010-fad2-48b8-b616-cd6b65ed9c9b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.653646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463010-fad2-48b8-b616-cd6b65ed9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.669979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463010-fad2-48b8-b616-cd6b65ed9c9b None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.669979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463010-fad2-48b8-b616-cd6b65ed9c9b None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.669979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463010-fad2-48b8-b616-cd6b65ed9c9b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.669979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 45/90] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:33 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:33.669979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463010-fad2-48b8-b616-cd6b65ed9c9b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.705229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07092875-151d-4d8f-ae6a-7fabb55ba430 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.742300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db47b97-5d46-45aa-97ff-003ba86f1c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.743867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47b97-5d46-45aa-97ff-003ba86f1c84 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.744164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47b97-5d46-45aa-97ff-003ba86f1c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.744497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47b97-5d46-45aa-97ff-003ba86f1c84 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.745216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db47b97-5d46-45aa-97ff-003ba86f1c84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.746707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db47b97-5d46-45aa-97ff-003ba86f1c84 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.776844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463010-fad2-48b8-b616-cd6b65ed9c9b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.804608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9fbc6-77c0-48bb-ad31-eded93beebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:33.806162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fbc6-77c0-48bb-ad31-eded93beebd7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:33.806452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fbc6-77c0-48bb-ad31-eded93beebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:33.806728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9fbc6-77c0-48bb-ad31-eded93beebd7 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:33.807904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9fbc6-77c0-48bb-ad31-eded93beebd7 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:33.809430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9fbc6-77c0-48bb-ad31-eded93beebd7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:33.811167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:33 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:33.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9fbc6-77c0-48bb-ad31-eded93beebd7 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.847868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 46/92] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:55:33 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:33.849014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db47b97-5d46-45aa-97ff-003ba86f1c84 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:33.861589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.902305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:33.956978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9fbc6-77c0-48bb-ad31-eded93beebd7 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:33.967046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db47b97-5d46-45aa-97ff-003ba86f1c84 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:34.004124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47afe3c-29eb-401f-8cbc-471ac844e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:34.004796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47afe3c-29eb-401f-8cbc-471ac844e0da None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:34.005143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47afe3c-29eb-401f-8cbc-471ac844e0da None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:34.005430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47afe3c-29eb-401f-8cbc-471ac844e0da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:34.008612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:34.009630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:34.010148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:34.010648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:34.011727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a, user.id=9fbe87ad0d3c4f67b20c51a5a999566b) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:34.012304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:34.014239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:34.028940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:33 2022] GET /identity/v3/role_assignments?user.id=9fbe87ad0d3c4f67b20c51a5a999566b&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=f3f138e4021a4b7dada39089dd427266 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:34.030279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:34.097064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47afe3c-29eb-401f-8cbc-471ac844e0da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:34.098974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47afe3c-29eb-401f-8cbc-471ac844e0da None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:34.141486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:34.177429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4b69a-2270-42ae-bd17-487e38f5159b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:34.183964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:34.248311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:34.249155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:34.249552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:34.249938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:34.250931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] RBAC: Adding query filter params (role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a, user.id=a941a87e586f4f72ade6be453d0effa2) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:34.251099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 47/94] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:34.251449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:34.253045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:34.257007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47afe3c-29eb-401f-8cbc-471ac844e0da None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:34.262918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 48/95] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:34 2022] GET /identity/v3/role_assignments?user.id=a941a87e586f4f72ade6be453d0effa2&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:34.384741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47afe3c-29eb-401f-8cbc-471ac844e0da None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:34.429268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d65c-e5c1-4b1f-bb1c-decdec93ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:34.430329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d65c-e5c1-4b1f-bb1c-decdec93ec89 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:34.430629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d65c-e5c1-4b1f-bb1c-decdec93ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:34.430913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d65c-e5c1-4b1f-bb1c-decdec93ec89 None admin] PATH_INFO: `/v3/projects/8fe707b5cd024514adcff753659e32ea` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:34.432269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35d65c-e5c1-4b1f-bb1c-decdec93ec89 None admin] RBAC: Authorizing `identity:get_project(project_id=8fe707b5cd024514adcff753659e32ea)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:34.433773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35d65c-e5c1-4b1f-bb1c-decdec93ec89 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:34.435621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:34 2022] GET /identity/v3/projects/8fe707b5cd024514adcff753659e32ea => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:34.442021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:34.554362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd81b2-8a03-4b55-9d43-412ff5468885 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:34.595534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a52f93-69b0-4e8e-907e-b7e2e18cbd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:34.596197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52f93-69b0-4e8e-907e-b7e2e18cbd65 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:34.596484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52f93-69b0-4e8e-907e-b7e2e18cbd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:34.596759 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52f93-69b0-4e8e-907e-b7e2e18cbd65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:34.597599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a52f93-69b0-4e8e-907e-b7e2e18cbd65 None admin] RBAC: Adding query filter params (role.id=ec78785738f441ec9be64e122e252506, scope.project.id=8fe707b5cd024514adcff753659e32ea, user.id=a941a87e586f4f72ade6be453d0effa2) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:34.597910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a52f93-69b0-4e8e-907e-b7e2e18cbd65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:34.599549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a52f93-69b0-4e8e-907e-b7e2e18cbd65 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:34.603393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:34.606874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 49/97] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:34 2022] GET /identity/v3/role_assignments?user.id=a941a87e586f4f72ade6be453d0effa2&scope.project.id=8fe707b5cd024514adcff753659e32ea&role.id=ec78785738f441ec9be64e122e252506 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:35.971816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777aa5-ee30-402c-9f2f-4304c8b85844 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:35.972306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777aa5-ee30-402c-9f2f-4304c8b85844 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:35.972378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777aa5-ee30-402c-9f2f-4304c8b85844 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:35.973769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 49/98] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:35.991341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282997e2-080e-4250-9ec5-fc6f894f70ab None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:35.991794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282997e2-080e-4250-9ec5-fc6f894f70ab None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:35.991972 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282997e2-080e-4250-9ec5-fc6f894f70ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:36.018958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-282997e2-080e-4250-9ec5-fc6f894f70ab None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:36.020218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-282997e2-080e-4250-9ec5-fc6f894f70ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:36.119889 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:36.157574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777aa5-ee30-402c-9f2f-4304c8b85844 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:36.203871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:36.303679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777aa5-ee30-402c-9f2f-4304c8b85844 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:36.345530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde81e48-14ec-4c52-903d-7f21ef344856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:36.346610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde81e48-14ec-4c52-903d-7f21ef344856 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:36.347044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde81e48-14ec-4c52-903d-7f21ef344856 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:36.347493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde81e48-14ec-4c52-903d-7f21ef344856 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:36.362983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde81e48-14ec-4c52-903d-7f21ef344856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-cde81e48-14ec-4c52-903d-7f21ef344856 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:36.371480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:36.372511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:36.373440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:36.379485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 50/100] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:36.391208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282997e2-080e-4250-9ec5-fc6f894f70ab None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:36.548501 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282997e2-080e-4250-9ec5-fc6f894f70ab None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:36.583995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:36.589788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:36.590486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:36.590776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:36.591046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:36.591796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:36.592102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:36.593512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:36.609474 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 51/101] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:36.615343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde81e48-14ec-4c52-903d-7f21ef344856 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:36.766446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:36.776155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde81e48-14ec-4c52-903d-7f21ef344856 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:36.821354 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934953e8-82f8-4213-ad95-ff30cea3bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:36.822266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934953e8-82f8-4213-ad95-ff30cea3bc3d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:36.822552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934953e8-82f8-4213-ad95-ff30cea3bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:36.822828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934953e8-82f8-4213-ad95-ff30cea3bc3d None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:36.826763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934953e8-82f8-4213-ad95-ff30cea3bc3d None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:36.828352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934953e8-82f8-4213-ad95-ff30cea3bc3d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:36.830217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 51/102] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:36 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:36.836166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:36.989829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d284b5e-7aba-4c30-a530-21812ec3bfda None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:37.033700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2113184-27b7-4d10-a39b-9fac688c48f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:37.035245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113184-27b7-4d10-a39b-9fac688c48f5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.035704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113184-27b7-4d10-a39b-9fac688c48f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.036127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113184-27b7-4d10-a39b-9fac688c48f5 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.042681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2113184-27b7-4d10-a39b-9fac688c48f5 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:37.044315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2113184-27b7-4d10-a39b-9fac688c48f5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:37.046225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 52/103] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:36 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:37.052199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934953e8-82f8-4213-ad95-ff30cea3bc3d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:37.242335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934953e8-82f8-4213-ad95-ff30cea3bc3d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:37.287684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e49239-07e5-4753-a2c2-f30a45e80061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:37.288598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e49239-07e5-4753-a2c2-f30a45e80061 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.288887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e49239-07e5-4753-a2c2-f30a45e80061 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.289305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e49239-07e5-4753-a2c2-f30a45e80061 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/users/a941a87e586f4f72ade6be453d0effa2/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.291862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e49239-07e5-4753-a2c2-f30a45e80061 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b08bbe0207849a5b6ee86bad98f3e1a, user_id=a941a87e586f4f72ade6be453d0effa2, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:37.293356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e49239-07e5-4753-a2c2-f30a45e80061 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:37.395828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 52/104] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:55:37 2022] PUT /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/users/a941a87e586f4f72ade6be453d0effa2/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:37.484128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb508c-b07e-48ff-9da7-822f78e09225 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.484783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb508c-b07e-48ff-9da7-822f78e09225 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.485273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb508c-b07e-48ff-9da7-822f78e09225 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.487208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 53/105] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:37.492891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cbd35-21dc-4200-9739-8fe2cc9b17fd None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.493149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cbd35-21dc-4200-9739-8fe2cc9b17fd None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.493405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cbd35-21dc-4200-9739-8fe2cc9b17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.517815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2a0cbd35-21dc-4200-9739-8fe2cc9b17fd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:37.519094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2a0cbd35-21dc-4200-9739-8fe2cc9b17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:37.538669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:37.560271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ee01-aac5-40c5-8183-190e2dd62824 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.560996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ee01-aac5-40c5-8183-190e2dd62824 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.561482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ee01-aac5-40c5-8183-190e2dd62824 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.563128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 54/106] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:37.574803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97cc1a-4c0f-43da-9d51-5090bbb784ee None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.575457 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97cc1a-4c0f-43da-9d51-5090bbb784ee None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.575805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97cc1a-4c0f-43da-9d51-5090bbb784ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.609091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8d97cc1a-4c0f-43da-9d51-5090bbb784ee None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:37.613294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8d97cc1a-4c0f-43da-9d51-5090bbb784ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:37.613432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 53/107] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:37.655166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cbd35-21dc-4200-9739-8fe2cc9b17fd None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:37.705309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:37.724199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 55/108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:37.756777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97cc1a-4c0f-43da-9d51-5090bbb784ee None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:37.795918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cbd35-21dc-4200-9739-8fe2cc9b17fd None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:37.856885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6757e-0d9c-46d2-98da-39380f479703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:37.857708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6757e-0d9c-46d2-98da-39380f479703 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.858016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6757e-0d9c-46d2-98da-39380f479703 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.858534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6757e-0d9c-46d2-98da-39380f479703 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.883575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6757e-0d9c-46d2-98da-39380f479703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-29e6757e-0d9c-46d2-98da-39380f479703 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:37.895328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:37.896248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:37.897477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 54/109] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:55:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:37.898175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637f61b-60db-473a-93a4-6c630eb73384 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.901951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637f61b-60db-473a-93a4-6c630eb73384 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.902274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637f61b-60db-473a-93a4-6c630eb73384 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.903830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 55/110] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:37.910110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8f93-4a53-4f8b-9f32-e6af1ec4f1ad None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.910409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8f93-4a53-4f8b-9f32-e6af1ec4f1ad None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.910694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8f93-4a53-4f8b-9f32-e6af1ec4f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.917829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97cc1a-4c0f-43da-9d51-5090bbb784ee None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:37.947976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-436a8f93-4a53-4f8b-9f32-e6af1ec4f1ad None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:37.949427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-436a8f93-4a53-4f8b-9f32-e6af1ec4f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:37.951596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:37.965670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0763ce2-4690-4b0a-98d3-681934d2202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:37.970189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0763ce2-4690-4b0a-98d3-681934d2202c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:37.970189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0763ce2-4690-4b0a-98d3-681934d2202c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:37.970189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0763ce2-4690-4b0a-98d3-681934d2202c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:37.989615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0763ce2-4690-4b0a-98d3-681934d2202c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f0763ce2-4690-4b0a-98d3-681934d2202c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:37.998567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:37.999455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 56/111] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:38.000699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0763ce2-4690-4b0a-98d3-681934d2202c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.066693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 56/112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:38.067800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:38.068407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a8f93-4a53-4f8b-9f32-e6af1ec4f1ad None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.122893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0763ce2-4690-4b0a-98d3-681934d2202c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.166681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfdfee-8c4d-4c3e-a374-3c9d76f28498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.167469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdfee-8c4d-4c3e-a374-3c9d76f28498 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.167761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdfee-8c4d-4c3e-a374-3c9d76f28498 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.168046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdfee-8c4d-4c3e-a374-3c9d76f28498 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.168808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfdfee-8c4d-4c3e-a374-3c9d76f28498 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:38.169114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfdfee-8c4d-4c3e-a374-3c9d76f28498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:38.170563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfdfee-8c4d-4c3e-a374-3c9d76f28498 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:38.172389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a8f93-4a53-4f8b-9f32-e6af1ec4f1ad None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.183813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 57/113] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:55:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:38.183813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2885f3b-fb63-471d-8713-a177689babc6 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.183813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2885f3b-fb63-471d-8713-a177689babc6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.183813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2885f3b-fb63-471d-8713-a177689babc6 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.183813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 58/114] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:38.184966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2885f3b-fb63-471d-8713-a177689babc6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.214499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1bb13-93ea-4f51-b39d-0bd6b1ac4fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.215177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bb13-93ea-4f51-b39d-0bd6b1ac4fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.215500 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bb13-93ea-4f51-b39d-0bd6b1ac4fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.215749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bb13-93ea-4f51-b39d-0bd6b1ac4fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.216504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bb13-93ea-4f51-b39d-0bd6b1ac4fa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:38.216817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bb13-93ea-4f51-b39d-0bd6b1ac4fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:38.218258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bb13-93ea-4f51-b39d-0bd6b1ac4fa4 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:38.224769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:38.229479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 57/115] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:38.231170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe313-e640-4fc7-ae6b-b9ac1a5a5a0a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.231495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe313-e640-4fc7-ae6b-b9ac1a5a5a0a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.231782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe313-e640-4fc7-ae6b-b9ac1a5a5a0a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.233432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 58/116] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:38.234236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe313-e640-4fc7-ae6b-b9ac1a5a5a0a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.302705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2885f3b-fb63-471d-8713-a177689babc6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.316551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:38.338761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a399cd-28c0-4e5a-822e-07de0b7a2a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.339590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a399cd-28c0-4e5a-822e-07de0b7a2a07 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.339847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a399cd-28c0-4e5a-822e-07de0b7a2a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.340132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a399cd-28c0-4e5a-822e-07de0b7a2a07 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.340223 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe313-e640-4fc7-ae6b-b9ac1a5a5a0a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.351186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a399cd-28c0-4e5a-822e-07de0b7a2a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-60a399cd-28c0-4e5a-822e-07de0b7a2a07 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:38.359756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:38.360576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:38.361348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 59/117] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:38.362529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730263-e966-4a21-bf15-ae4d392256cd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.362699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730263-e966-4a21-bf15-ae4d392256cd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.362975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730263-e966-4a21-bf15-ae4d392256cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.380332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02621a58-823e-410b-9475-77eabac4adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.380871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-93730263-e966-4a21-bf15-ae4d392256cd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:38.381272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621a58-823e-410b-9475-77eabac4adfe None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.381560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621a58-823e-410b-9475-77eabac4adfe None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.381842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621a58-823e-410b-9475-77eabac4adfe None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.382105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-93730263-e966-4a21-bf15-ae4d392256cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:38.383111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02621a58-823e-410b-9475-77eabac4adfe None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:38.384593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02621a58-823e-410b-9475-77eabac4adfe None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:38.386432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 59/118] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:38.391228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02621a58-823e-410b-9475-77eabac4adfe None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.452436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 60/119] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:38.453813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6dc9-5a2b-42f3-9e6a-3a8d8e9b6375 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.454146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6dc9-5a2b-42f3-9e6a-3a8d8e9b6375 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.454433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6dc9-5a2b-42f3-9e6a-3a8d8e9b6375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.475713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:38.481221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b3ef6dc9-5a2b-42f3-9e6a-3a8d8e9b6375 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:38.482443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b3ef6dc9-5a2b-42f3-9e6a-3a8d8e9b6375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:38.510538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02621a58-823e-410b-9475-77eabac4adfe None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.546829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3e74-7deb-405c-be6d-f47304f7e0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.547978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3e74-7deb-405c-be6d-f47304f7e0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.548259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3e74-7deb-405c-be6d-f47304f7e0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.548532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3e74-7deb-405c-be6d-f47304f7e0a7 None admin] PATH_INFO: `/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.549713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c3e74-7deb-405c-be6d-f47304f7e0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbe87ad0d3c4f67b20c51a5a999566b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:38.551210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c3e74-7deb-405c-be6d-f47304f7e0a7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:38.553055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 60/120] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:38.554145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 61/121] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:38.555556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6dc9-5a2b-42f3-9e6a-3a8d8e9b6375 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.558525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3e74-7deb-405c-be6d-f47304f7e0a7 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.592693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:38.662792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3e74-7deb-405c-be6d-f47304f7e0a7 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.672557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6dc9-5a2b-42f3-9e6a-3a8d8e9b6375 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.700475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.701138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.701419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.701698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.702468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:38.702777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:38.704153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:38.706374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:38.707219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d386a-1291-491a-983a-fe91928d804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.708074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d386a-1291-491a-983a-fe91928d804a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.708363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d386a-1291-491a-983a-fe91928d804a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.708642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d386a-1291-491a-983a-fe91928d804a None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.710289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d386a-1291-491a-983a-fe91928d804a None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:38.712265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d386a-1291-491a-983a-fe91928d804a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:38.718042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 61/122] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:38.718042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.721841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 62/123] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:38.721841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d386a-1291-491a-983a-fe91928d804a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.828713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880b27b-115b-4f36-82dc-62dfb88880eb None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.829335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:38.832299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d386a-1291-491a-983a-fe91928d804a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.865347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49965aa-2da9-4711-861a-c0e30c6ae1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.866354 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49965aa-2da9-4711-861a-c0e30c6ae1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.866715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49965aa-2da9-4711-861a-c0e30c6ae1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.867004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49965aa-2da9-4711-861a-c0e30c6ae1b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.875380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18709bd5-3a7c-41ac-8bbc-1464da4600ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:38.876249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18709bd5-3a7c-41ac-8bbc-1464da4600ec None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:38.876540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18709bd5-3a7c-41ac-8bbc-1464da4600ec None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:38.876823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18709bd5-3a7c-41ac-8bbc-1464da4600ec None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:38.877525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49965aa-2da9-4711-861a-c0e30c6ae1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:38.878047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18709bd5-3a7c-41ac-8bbc-1464da4600ec None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:38.879528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18709bd5-3a7c-41ac-8bbc-1464da4600ec None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:38.886086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 63/124] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:38.886086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18709bd5-3a7c-41ac-8bbc-1464da4600ec None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-d49965aa-2da9-4711-861a-c0e30c6ae1b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:38.886296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:38.887087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:38.887832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:38.891335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 62/125] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:38.892093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49965aa-2da9-4711-861a-c0e30c6ae1b4 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:38.955271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:38.989910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18709bd5-3a7c-41ac-8bbc-1464da4600ec None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:38.998481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49965aa-2da9-4711-861a-c0e30c6ae1b4 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:39.026751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca975ffa-da98-4732-ad8b-2a8741e21745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:39.027661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca975ffa-da98-4732-ad8b-2a8741e21745 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:39.027955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca975ffa-da98-4732-ad8b-2a8741e21745 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:39.028241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca975ffa-da98-4732-ad8b-2a8741e21745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:39.029415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca975ffa-da98-4732-ad8b-2a8741e21745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:39.030931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca975ffa-da98-4732-ad8b-2a8741e21745 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:39.032711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 64/126] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:39.032948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153719-748d-42f2-8b4a-9ff26178bca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:39.033817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153719-748d-42f2-8b4a-9ff26178bca8 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:39.034137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153719-748d-42f2-8b4a-9ff26178bca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:39.034418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153719-748d-42f2-8b4a-9ff26178bca8 None admin] PATH_INFO: `/v3/users/57e531abe4c647a0b0304371ff9c81f2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:39.037911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca975ffa-da98-4732-ad8b-2a8741e21745 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:39.048379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153719-748d-42f2-8b4a-9ff26178bca8 None admin] RBAC: Authorizing `identity:get_user(user_id=57e531abe4c647a0b0304371ff9c81f2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:39.049850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153719-748d-42f2-8b4a-9ff26178bca8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:39.051559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 63/127] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:38 2022] GET /identity/v3/users/57e531abe4c647a0b0304371ff9c81f2 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:39.052298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153719-748d-42f2-8b4a-9ff26178bca8 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:39.078600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:39.146702 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca975ffa-da98-4732-ad8b-2a8741e21745 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:39.160772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153719-748d-42f2-8b4a-9ff26178bca8 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:39.203079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:39.220188 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f70ea-4302-45ab-93df-80d868f9e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:39.225333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f70ea-4302-45ab-93df-80d868f9e9af None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:39.225333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f70ea-4302-45ab-93df-80d868f9e9af None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:39.225333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f70ea-4302-45ab-93df-80d868f9e9af None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/users/a941a87e586f4f72ade6be453d0effa2/roles/961dfd3ce0344659aaf2e9c80164893e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:39.225548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0724ca-b816-4f70-aa11-68daa9862b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:39.225548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0724ca-b816-4f70-aa11-68daa9862b45 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:39.225548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0724ca-b816-4f70-aa11-68daa9862b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:39.225746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f70ea-4302-45ab-93df-80d868f9e9af None admin] RBAC: Authorizing `identity:create_grant(project_id=4b08bbe0207849a5b6ee86bad98f3e1a, user_id=a941a87e586f4f72ade6be453d0effa2, role_id=961dfd3ce0344659aaf2e9c80164893e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:39.225817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0724ca-b816-4f70-aa11-68daa9862b45 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/users/9fbe87ad0d3c4f67b20c51a5a999566b/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:39.225894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f70ea-4302-45ab-93df-80d868f9e9af None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:39.225988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0724ca-b816-4f70-aa11-68daa9862b45 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b08bbe0207849a5b6ee86bad98f3e1a, user_id=9fbe87ad0d3c4f67b20c51a5a999566b, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:39.227527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0724ca-b816-4f70-aa11-68daa9862b45 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:39.309404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 65/128] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:55:39 2022] PUT /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/users/a941a87e586f4f72ade6be453d0effa2/roles/961dfd3ce0344659aaf2e9c80164893e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:39.310539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f70ea-4302-45ab-93df-80d868f9e9af None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:39.344542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 64/129] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:55:39 2022] PUT /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/users/9fbe87ad0d3c4f67b20c51a5a999566b/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:39.346066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0724ca-b816-4f70-aa11-68daa9862b45 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:39.458521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:39.465275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f70ea-4302-45ab-93df-80d868f9e9af None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:39.484952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0724ca-b816-4f70-aa11-68daa9862b45 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:39.534526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9903-c356-427c-bc5f-591130e1277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:39.535876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9903-c356-427c-bc5f-591130e1277b None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:39.536370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9903-c356-427c-bc5f-591130e1277b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:39.537004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9903-c356-427c-bc5f-591130e1277b None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:39.537990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb9903-c356-427c-bc5f-591130e1277b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:39.541079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb9903-c356-427c-bc5f-591130e1277b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:39.558007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:39.558987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:39.559113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:39.559402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:39.560336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:39.560647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:39.563462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:39.572417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 66/130] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:39.573613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:39.663573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 65/131] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:55:39 2022] POST /identity/v3/projects => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:39.663573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9903-c356-427c-bc5f-591130e1277b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:39.733779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c9a59-d35c-42a9-b96e-bb45fa655f4f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:39.736959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:39.799063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4528d9-21c7-4d7b-ba9a-9832920d5bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:39.799827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4528d9-21c7-4d7b-ba9a-9832920d5bcd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:39.800231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4528d9-21c7-4d7b-ba9a-9832920d5bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:39.800625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4528d9-21c7-4d7b-ba9a-9832920d5bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:39.828852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9903-c356-427c-bc5f-591130e1277b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:39.850391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:39.899426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d9460-94f3-4e03-8f88-c0687a16915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:39.900331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9460-94f3-4e03-8f88-c0687a16915f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:39.900619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9460-94f3-4e03-8f88-c0687a16915f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:39.900899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9460-94f3-4e03-8f88-c0687a16915f None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:39.905608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d9460-94f3-4e03-8f88-c0687a16915f None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:39.907141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d9460-94f3-4e03-8f88-c0687a16915f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:39.908826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 66/132] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:39 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:39.913439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4528d9-21c7-4d7b-ba9a-9832920d5bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:39.919344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4528d9-21c7-4d7b-ba9a-9832920d5bcd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:39.923048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d9460-94f3-4e03-8f88-c0687a16915f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:40.028378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:40.033919 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d9460-94f3-4e03-8f88-c0687a16915f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:40.047753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 67/133] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:40.049309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbd19-7692-4947-8b56-26b0cea8eff5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:40.049604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbd19-7692-4947-8b56-26b0cea8eff5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:40.049890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbd19-7692-4947-8b56-26b0cea8eff5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:40.055403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 68/134] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:40.056241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bbd19-7692-4947-8b56-26b0cea8eff5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:40.069741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f53a0-449a-422e-8b5f-1278bd125975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:40.071199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f53a0-449a-422e-8b5f-1278bd125975 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:40.071495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f53a0-449a-422e-8b5f-1278bd125975 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:40.071881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f53a0-449a-422e-8b5f-1278bd125975 None admin] PATH_INFO: `/v3/projects/8fe707b5cd024514adcff753659e32ea` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:40.074417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f53a0-449a-422e-8b5f-1278bd125975 None admin] RBAC: Authorizing `identity:get_project(project_id=8fe707b5cd024514adcff753659e32ea)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:40.076009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f53a0-449a-422e-8b5f-1278bd125975 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:40.078099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 67/135] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:39 2022] GET /identity/v3/projects/8fe707b5cd024514adcff753659e32ea => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:40.079054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab2c8c-3bfe-4620-9a40-65b5435cb287 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:40.079345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab2c8c-3bfe-4620-9a40-65b5435cb287 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:40.079727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab2c8c-3bfe-4620-9a40-65b5435cb287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:40.097920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-6dab2c8c-3bfe-4620-9a40-65b5435cb287 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:40.099132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6dab2c8c-3bfe-4620-9a40-65b5435cb287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:40.131604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:40.188477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bbd19-7692-4947-8b56-26b0cea8eff5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:40.211658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 68/136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:40.212320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab2c8c-3bfe-4620-9a40-65b5435cb287 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:40.228060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41868f84-0d95-448d-96ca-7237deeed576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:40.229225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41868f84-0d95-448d-96ca-7237deeed576 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:40.229741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41868f84-0d95-448d-96ca-7237deeed576 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:40.230223 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41868f84-0d95-448d-96ca-7237deeed576 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:40.231628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41868f84-0d95-448d-96ca-7237deeed576 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:40.233424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41868f84-0d95-448d-96ca-7237deeed576 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:40.236193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 69/137] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:40 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:40.244904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41868f84-0d95-448d-96ca-7237deeed576 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:40.349360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:40.356183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab2c8c-3bfe-4620-9a40-65b5435cb287 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:40.391763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4d86f-02b9-4c3b-99ab-2db6064327e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:40.392666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d86f-02b9-4c3b-99ab-2db6064327e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:40.392950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d86f-02b9-4c3b-99ab-2db6064327e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:40.393229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d86f-02b9-4c3b-99ab-2db6064327e6 None admin] PATH_INFO: `/v3/projects/8fe707b5cd024514adcff753659e32ea/users/a941a87e586f4f72ade6be453d0effa2/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:40.395283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4d86f-02b9-4c3b-99ab-2db6064327e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fe707b5cd024514adcff753659e32ea, user_id=a941a87e586f4f72ade6be453d0effa2, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:40.396747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4d86f-02b9-4c3b-99ab-2db6064327e6 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:40.431976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41868f84-0d95-448d-96ca-7237deeed576 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:40.460178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:40.469539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:40.470252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:40.470544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:40.470828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:40.471748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] RBAC: Adding query filter params (role.id=84808704b93544b6b353735cb3c5825f, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a, user.id=57e531abe4c647a0b0304371ff9c81f2) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:40.472124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:40.473668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:40.479947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 70/138] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:40 2022] GET /identity/v3/role_assignments?user.id=57e531abe4c647a0b0304371ff9c81f2&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=84808704b93544b6b353735cb3c5825f => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:40.480808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:40.516341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:55:40 2022] PUT /identity/v3/projects/8fe707b5cd024514adcff753659e32ea/users/a941a87e586f4f72ade6be453d0effa2/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:40.632777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553014f-e893-48e0-8007-ef4407872571 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:40.673461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8d2c0-103e-4bb1-9342-02af2f939144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:40.674354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8d2c0-103e-4bb1-9342-02af2f939144 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:40.674640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8d2c0-103e-4bb1-9342-02af2f939144 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:40.674918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8d2c0-103e-4bb1-9342-02af2f939144 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:40.694580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8d2c0-103e-4bb1-9342-02af2f939144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0be8d2c0-103e-4bb1-9342-02af2f939144 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:40.702821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:40.703677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:40.704409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 71/140] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:40.715225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4d86f-02b9-4c3b-99ab-2db6064327e6 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:40.857593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4d86f-02b9-4c3b-99ab-2db6064327e6 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:40.896981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:40.897597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:40.897890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:40.898206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:40.899526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] RBAC: Adding query filter params (name=member) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:40.899839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:40.901301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:40.911181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 70/141] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:40.917517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8d2c0-103e-4bb1-9342-02af2f939144 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:40.978095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:41.034263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8d2c0-103e-4bb1-9342-02af2f939144 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:41.070935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd46738-d19b-4f0f-b903-6bad310fc63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:41.071814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46738-d19b-4f0f-b903-6bad310fc63a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:41.072097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46738-d19b-4f0f-b903-6bad310fc63a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:41.072376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46738-d19b-4f0f-b903-6bad310fc63a None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:41.073823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd46738-d19b-4f0f-b903-6bad310fc63a None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:41.075311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd46738-d19b-4f0f-b903-6bad310fc63a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:41.077260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 72/142] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:40 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:41.082603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:41.110086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:41.203566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bace9-179b-4659-8bfd-dbde8f403642 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:41.245411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00957c-5360-4fbc-b780-0a1ba27f9993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:41.246119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00957c-5360-4fbc-b780-0a1ba27f9993 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:41.246417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00957c-5360-4fbc-b780-0a1ba27f9993 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:41.246703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00957c-5360-4fbc-b780-0a1ba27f9993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:41.317913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00957c-5360-4fbc-b780-0a1ba27f9993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:41.319666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00957c-5360-4fbc-b780-0a1ba27f9993 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:41.338561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:41.432709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 71/143] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:41.438649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd46738-d19b-4f0f-b903-6bad310fc63a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:41.588167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd46738-d19b-4f0f-b903-6bad310fc63a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:41.612643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:41.633507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788aebe-1790-4513-b9c3-1c528cfdda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:41.634408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788aebe-1790-4513-b9c3-1c528cfdda66 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:41.634696 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788aebe-1790-4513-b9c3-1c528cfdda66 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:41.634976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788aebe-1790-4513-b9c3-1c528cfdda66 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:41.638678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788aebe-1790-4513-b9c3-1c528cfdda66 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:41.640152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788aebe-1790-4513-b9c3-1c528cfdda66 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:41.641981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 73/144] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:41 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:41.647916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00957c-5360-4fbc-b780-0a1ba27f9993 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:41.774520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00957c-5360-4fbc-b780-0a1ba27f9993 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:41.799232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:41.821455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5161ab8-84aa-4eb1-acba-80f8afbfb4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:41.822172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161ab8-84aa-4eb1-acba-80f8afbfb4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:41.822467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161ab8-84aa-4eb1-acba-80f8afbfb4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:41.822749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5161ab8-84aa-4eb1-acba-80f8afbfb4b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:41.823852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5161ab8-84aa-4eb1-acba-80f8afbfb4b2 None admin] RBAC: Adding query filter params (role.id=ec78785738f441ec9be64e122e252506, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a, user.id=a941a87e586f4f72ade6be453d0effa2) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:41.824175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5161ab8-84aa-4eb1-acba-80f8afbfb4b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:41.825627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5161ab8-84aa-4eb1-acba-80f8afbfb4b2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:41.837901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 72/145] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:41 2022] GET /identity/v3/role_assignments?user.id=a941a87e586f4f72ade6be453d0effa2&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=ec78785738f441ec9be64e122e252506 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:42.540960 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12baa-3e8d-47b9-a837-901ab285dee9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:42.541484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12baa-3e8d-47b9-a837-901ab285dee9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:42.541558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12baa-3e8d-47b9-a837-901ab285dee9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:42.542919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 74/146] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:42.548464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6cc70-fc47-46c9-83e7-22a96c05310e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:42.548857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6cc70-fc47-46c9-83e7-22a96c05310e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:42.549021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6cc70-fc47-46c9-83e7-22a96c05310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:42.568330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-22b6cc70-fc47-46c9-83e7-22a96c05310e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:42.569530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-22b6cc70-fc47-46c9-83e7-22a96c05310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:42.658695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:42.690461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12baa-3e8d-47b9-a837-901ab285dee9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:42.827783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12baa-3e8d-47b9-a837-901ab285dee9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:42.873508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb19715-b251-491d-a649-2aa9c8f33b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:42.874341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19715-b251-491d-a649-2aa9c8f33b13 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:42.874632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19715-b251-491d-a649-2aa9c8f33b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:42.874909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb19715-b251-491d-a649-2aa9c8f33b13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:42.891272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb19715-b251-491d-a649-2aa9c8f33b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8bb19715-b251-491d-a649-2aa9c8f33b13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:42.899550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:42.900381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:42.901129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 75/148] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:55:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:42.908118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6cc70-fc47-46c9-83e7-22a96c05310e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:43.022570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3860-92da-454f-9f92-2fc8a3a5bb34 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.023221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3860-92da-454f-9f92-2fc8a3a5bb34 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.023713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db3860-92da-454f-9f92-2fc8a3a5bb34 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.025402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 76/149] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:43.030456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52d078-70fd-4480-940f-fd3a6837fbc8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.030970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52d078-70fd-4480-940f-fd3a6837fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.031609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52d078-70fd-4480-940f-fd3a6837fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.059666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ee52d078-70fd-4480-940f-fd3a6837fbc8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:43.062047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6cc70-fc47-46c9-83e7-22a96c05310e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:43.064695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ee52d078-70fd-4480-940f-fd3a6837fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:43.076277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:43.126999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:43.127992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.128532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.128998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.130016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:43.130526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:43.134953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:43.135658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:43.149835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 74/150] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:55:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:43.157899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:43.199955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 77/151] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:43.251409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52d078-70fd-4480-940f-fd3a6837fbc8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:43.319102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4c46-7865-4f78-8617-c7ff63c077aa None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:43.359375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224f7d1-a679-49e9-a80d-a5b371c9c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:43.360578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f7d1-a679-49e9-a80d-a5b371c9c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.361041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f7d1-a679-49e9-a80d-a5b371c9c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.361549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224f7d1-a679-49e9-a80d-a5b371c9c9f4 None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.363156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f7d1-a679-49e9-a80d-a5b371c9c9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:43.364899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224f7d1-a679-49e9-a80d-a5b371c9c9f4 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:43.367292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 75/152] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:43 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:43.373209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01c12-c8bb-433e-896b-2b7a31aa05e0 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.374080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01c12-c8bb-433e-896b-2b7a31aa05e0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.374545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01c12-c8bb-433e-896b-2b7a31aa05e0 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.376263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 76/153] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:43.377327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a01c12-c8bb-433e-896b-2b7a31aa05e0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:43.403707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52d078-70fd-4480-940f-fd3a6837fbc8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:43.427593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:43.451094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02537534-d614-4a8a-abf3-1b4d373c04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:43.452071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537534-d614-4a8a-abf3-1b4d373c04ec None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.452366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537534-d614-4a8a-abf3-1b4d373c04ec None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.452635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537534-d614-4a8a-abf3-1b4d373c04ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.469274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02537534-d614-4a8a-abf3-1b4d373c04ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-02537534-d614-4a8a-abf3-1b4d373c04ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:43.479981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:43.480958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:43.481714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 78/154] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:55:43.482735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8870054-7e19-4581-a47d-65dd6de0064e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.482735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8870054-7e19-4581-a47d-65dd6de0064e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.482939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8870054-7e19-4581-a47d-65dd6de0064e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.502939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f8870054-7e19-4581-a47d-65dd6de0064e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:43.504091 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a01c12-c8bb-433e-896b-2b7a31aa05e0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:43.504199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f8870054-7e19-4581-a47d-65dd6de0064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:43.535753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:43.544900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9fc80-d3d6-4dd4-9f66-ce3c64e4c160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:43.545857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9fc80-d3d6-4dd4-9f66-ce3c64e4c160 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.546235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9fc80-d3d6-4dd4-9f66-ce3c64e4c160 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.546607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9fc80-d3d6-4dd4-9f66-ce3c64e4c160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.578281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 79/155] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:43.580022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8870054-7e19-4581-a47d-65dd6de0064e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:43.619387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9fc80-d3d6-4dd4-9f66-ce3c64e4c160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:43.621259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9fc80-d3d6-4dd4-9f66-ce3c64e4c160 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:43.662303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:43.682797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8870054-7e19-4581-a47d-65dd6de0064e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:43.718330 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4c501-912d-4b08-9f09-b3a46e6f49e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:43.719022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c501-912d-4b08-9f09-b3a46e6f49e0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.719304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c501-912d-4b08-9f09-b3a46e6f49e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.719575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4c501-912d-4b08-9f09-b3a46e6f49e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.720317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4c501-912d-4b08-9f09-b3a46e6f49e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:43.720624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4c501-912d-4b08-9f09-b3a46e6f49e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:43.725215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 77/156] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:43.725215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee01b8-527c-4c85-a17d-c0451495d0a2 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.725344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4c501-912d-4b08-9f09-b3a46e6f49e0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:43.725408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee01b8-527c-4c85-a17d-c0451495d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.725408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee01b8-527c-4c85-a17d-c0451495d0a2 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.725408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 78/157] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:43.725408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee01b8-527c-4c85-a17d-c0451495d0a2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:43.734117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 80/158] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:43.735583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31704ca1-a650-4726-9dae-a5f7acc7a0ef None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.735939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31704ca1-a650-4726-9dae-a5f7acc7a0ef None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.736227 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31704ca1-a650-4726-9dae-a5f7acc7a0ef None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.737504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 81/159] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:43.742297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31704ca1-a650-4726-9dae-a5f7acc7a0ef None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:43.770618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:43.827616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee01b8-527c-4c85-a17d-c0451495d0a2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:43.844452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31704ca1-a650-4726-9dae-a5f7acc7a0ef None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:43.861685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a628629-06be-4b2c-b767-27c6df8c32ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:43.862497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a628629-06be-4b2c-b767-27c6df8c32ef None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.862784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a628629-06be-4b2c-b767-27c6df8c32ef None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.863062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a628629-06be-4b2c-b767-27c6df8c32ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.864221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a628629-06be-4b2c-b767-27c6df8c32ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:43.865672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a628629-06be-4b2c-b767-27c6df8c32ef None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:43.867826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 79/160] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:43.869041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72e706-a0cd-4556-862a-02bb908c6569 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.869326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72e706-a0cd-4556-862a-02bb908c6569 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.869603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72e706-a0cd-4556-862a-02bb908c6569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.883408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa642-9e36-4319-bda0-dd55df95cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:43.884266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa642-9e36-4319-bda0-dd55df95cc40 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.884552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa642-9e36-4319-bda0-dd55df95cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.884829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa642-9e36-4319-bda0-dd55df95cc40 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.885529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8b72e706-a0cd-4556-862a-02bb908c6569 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:43.886043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa642-9e36-4319-bda0-dd55df95cc40 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:43.886739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8b72e706-a0cd-4556-862a-02bb908c6569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:43.887502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa642-9e36-4319-bda0-dd55df95cc40 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:43.888661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:43.889362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 82/161] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:43 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:43.889951 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa642-9e36-4319-bda0-dd55df95cc40 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:43.956438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 80/162] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:43.957692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9970e-da69-4476-86fe-68d33ac8463e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:43.958015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9970e-da69-4476-86fe-68d33ac8463e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:43.958296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9970e-da69-4476-86fe-68d33ac8463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:43.973791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-27c9970e-da69-4476-86fe-68d33ac8463e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:43.975090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-27c9970e-da69-4476-86fe-68d33ac8463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:43.992481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:43.998533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa642-9e36-4319-bda0-dd55df95cc40 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.031636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c24f6-1c17-49b5-8d50-4d47f8551b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:44.032493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c24f6-1c17-49b5-8d50-4d47f8551b08 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:44.032779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c24f6-1c17-49b5-8d50-4d47f8551b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:44.033052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c24f6-1c17-49b5-8d50-4d47f8551b08 None admin] PATH_INFO: `/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:44.034252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c24f6-1c17-49b5-8d50-4d47f8551b08 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbe87ad0d3c4f67b20c51a5a999566b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:44.035753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c24f6-1c17-49b5-8d50-4d47f8551b08 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:44.037293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 83/163] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:43 2022] GET /identity/v3/users/9fbe87ad0d3c4f67b20c51a5a999566b => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:44.038051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c24f6-1c17-49b5-8d50-4d47f8551b08 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.042383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 81/164] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:44.043254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9970e-da69-4476-86fe-68d33ac8463e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.109386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:44.142829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9970e-da69-4476-86fe-68d33ac8463e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.143286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c24f6-1c17-49b5-8d50-4d47f8551b08 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.175646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcc9f1-fd51-4dc1-85c7-3fc372a23087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:44.176371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcc9f1-fd51-4dc1-85c7-3fc372a23087 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:44.176658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcc9f1-fd51-4dc1-85c7-3fc372a23087 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:44.176935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcc9f1-fd51-4dc1-85c7-3fc372a23087 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:44.177116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:44.177628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:44.177715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcc9f1-fd51-4dc1-85c7-3fc372a23087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:44.177909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:44.178213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:44.179038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] RBAC: Adding query filter params (role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a, user.id=a941a87e586f4f72ade6be453d0effa2) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:44.179125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcc9f1-fd51-4dc1-85c7-3fc372a23087 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:44.179347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:44.181293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:44.187168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 82/165] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:44 2022] GET /identity/v3/role_assignments?user.id=a941a87e586f4f72ade6be453d0effa2&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:44.187859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.259833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 84/166] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:55:44 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:44.260720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcc9f1-fd51-4dc1-85c7-3fc372a23087 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.297880 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:44.321573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9c7bd-b776-43dc-a262-4ae116ae448a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.365001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:44.371881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc7a5-86fd-4a5f-860f-c578537defd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:44.373423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc7a5-86fd-4a5f-860f-c578537defd7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:44.373864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc7a5-86fd-4a5f-860f-c578537defd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:44.374311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc7a5-86fd-4a5f-860f-c578537defd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:44.387644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facc7a5-86fd-4a5f-860f-c578537defd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-8facc7a5-86fd-4a5f-860f-c578537defd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:44.396787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:44.397982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:55:44.399162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:44.401404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 83/167] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:44.402920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc7a5-86fd-4a5f-860f-c578537defd7 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.405080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcc9f1-fd51-4dc1-85c7-3fc372a23087 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.449586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be8c2-adb9-43d6-8e85-7ef0c7f43196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:44.450292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be8c2-adb9-43d6-8e85-7ef0c7f43196 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:44.450578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be8c2-adb9-43d6-8e85-7ef0c7f43196 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:44.450862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be8c2-adb9-43d6-8e85-7ef0c7f43196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:44.536865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc7a5-86fd-4a5f-860f-c578537defd7 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.541128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672be8c2-adb9-43d6-8e85-7ef0c7f43196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:44.542881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672be8c2-adb9-43d6-8e85-7ef0c7f43196 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:44.566642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:44.575528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d031d-418f-4f9e-8f0a-4b7d43218898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:44.576337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d031d-418f-4f9e-8f0a-4b7d43218898 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:44.576620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d031d-418f-4f9e-8f0a-4b7d43218898 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:44.576894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d031d-418f-4f9e-8f0a-4b7d43218898 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:44.595110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d031d-418f-4f9e-8f0a-4b7d43218898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-c02d031d-418f-4f9e-8f0a-4b7d43218898 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:44.603202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:44.604075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:44.604910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 84/168] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:44.605544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d031d-418f-4f9e-8f0a-4b7d43218898 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.676118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:44.676729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 85/169] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:44.677058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be8c2-adb9-43d6-8e85-7ef0c7f43196 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.754747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d031d-418f-4f9e-8f0a-4b7d43218898 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.798112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be8c2-adb9-43d6-8e85-7ef0c7f43196 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.806233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:44.806917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:44.807209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:44.807959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:44.808731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:44.809045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:44.811492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:44.823569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 85/170] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:44.827105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.830749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:44.847529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:44.848656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:44.849139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:44.849621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:44.850613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:44.851835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:44.853354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:44.864229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 86/171] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:44.865351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:44.969323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9c5f6-d370-400e-af48-b826ae276821 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:44.986409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:45.008937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06418-1571-42da-8bda-f2922b22e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:45.010216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06418-1571-42da-8bda-f2922b22e6fa None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:45.010736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06418-1571-42da-8bda-f2922b22e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:45.011214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06418-1571-42da-8bda-f2922b22e6fa None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:45.013839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a06418-1571-42da-8bda-f2922b22e6fa None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:45.015553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a06418-1571-42da-8bda-f2922b22e6fa None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:45.017449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 86/172] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:44 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:45.018555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06418-1571-42da-8bda-f2922b22e6fa None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:45.073386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9317aba-823d-445c-9832-cc4d848162fa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:45.125109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767759b-3744-4f64-a823-4e7f423d3e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:45.126027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767759b-3744-4f64-a823-4e7f423d3e66 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:45.126317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767759b-3744-4f64-a823-4e7f423d3e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:45.126591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767759b-3744-4f64-a823-4e7f423d3e66 None admin] PATH_INFO: `/v3/users/57e531abe4c647a0b0304371ff9c81f2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:45.132273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767759b-3744-4f64-a823-4e7f423d3e66 None admin] RBAC: Authorizing `identity:get_user(user_id=57e531abe4c647a0b0304371ff9c81f2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:45.134468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767759b-3744-4f64-a823-4e7f423d3e66 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:45.136330 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 87/173] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:44 2022] GET /identity/v3/users/57e531abe4c647a0b0304371ff9c81f2 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:45.136903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767759b-3744-4f64-a823-4e7f423d3e66 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:45.179910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06418-1571-42da-8bda-f2922b22e6fa None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:45.222353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:45.243978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b02bb9-6e09-45ad-b4c4-4639fb651339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:45.244869 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b02bb9-6e09-45ad-b4c4-4639fb651339 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:45.245151 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b02bb9-6e09-45ad-b4c4-4639fb651339 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:45.245423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b02bb9-6e09-45ad-b4c4-4639fb651339 None admin] PATH_INFO: `/v3/users/a941a87e586f4f72ade6be453d0effa2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:45.247542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b02bb9-6e09-45ad-b4c4-4639fb651339 None admin] RBAC: Authorizing `identity:get_user(user_id=a941a87e586f4f72ade6be453d0effa2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:45.249017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b02bb9-6e09-45ad-b4c4-4639fb651339 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:45.250879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 87/174] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:45 2022] GET /identity/v3/users/a941a87e586f4f72ade6be453d0effa2 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:45.251488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b02bb9-6e09-45ad-b4c4-4639fb651339 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:45.302114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767759b-3744-4f64-a823-4e7f423d3e66 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:45.333496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:45.363749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:45.364396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:45.364679 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:45.364954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:45.365932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a, user.id=9fbe87ad0d3c4f67b20c51a5a999566b) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:45.366178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:45.368166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:45.382409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 88/175] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:45 2022] GET /identity/v3/role_assignments?user.id=9fbe87ad0d3c4f67b20c51a5a999566b&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=f3f138e4021a4b7dada39089dd427266 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:45.383823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:45.414461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b02bb9-6e09-45ad-b4c4-4639fb651339 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:45.455875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65e47-8eac-4c91-b886-d9ff7c9af0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:45.456742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65e47-8eac-4c91-b886-d9ff7c9af0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:45.457025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65e47-8eac-4c91-b886-d9ff7c9af0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:45.457298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65e47-8eac-4c91-b886-d9ff7c9af0f7 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:45.459502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed65e47-8eac-4c91-b886-d9ff7c9af0f7 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:45.461076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed65e47-8eac-4c91-b886-d9ff7c9af0f7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:45.464361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 88/176] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:45 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:45.468922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65e47-8eac-4c91-b886-d9ff7c9af0f7 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:45.600648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbaa85-c75f-472c-a35f-43f6be7da03c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:45.629165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:45.660877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65e47-8eac-4c91-b886-d9ff7c9af0f7 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:45.663715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49301048-f423-4cb5-92c7-74ab33258bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:45.664390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49301048-f423-4cb5-92c7-74ab33258bde None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:45.664680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49301048-f423-4cb5-92c7-74ab33258bde None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:45.664967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49301048-f423-4cb5-92c7-74ab33258bde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:45.690611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:45.734976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd479629-a139-4379-a58e-f4814632d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:45.736740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd479629-a139-4379-a58e-f4814632d1d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:45.737030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd479629-a139-4379-a58e-f4814632d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:45.737312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd479629-a139-4379-a58e-f4814632d1d1 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/users/57e531abe4c647a0b0304371ff9c81f2/roles/84808704b93544b6b353735cb3c5825f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:45.742589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd479629-a139-4379-a58e-f4814632d1d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b08bbe0207849a5b6ee86bad98f3e1a, user_id=57e531abe4c647a0b0304371ff9c81f2, role_id=84808704b93544b6b353735cb3c5825f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:45.744064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd479629-a139-4379-a58e-f4814632d1d1 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:45.792803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49301048-f423-4cb5-92c7-74ab33258bde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:45.794522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49301048-f423-4cb5-92c7-74ab33258bde None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:45.834697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 89/177] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:55:45 2022] PUT /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/users/57e531abe4c647a0b0304371ff9c81f2/roles/84808704b93544b6b353735cb3c5825f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:45.916130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 89/178] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:45.921802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd479629-a139-4379-a58e-f4814632d1d1 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:46.080605 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd479629-a139-4379-a58e-f4814632d1d1 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:46.130862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628f36e-a948-46ce-a275-2b82bee4c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:46.131830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628f36e-a948-46ce-a275-2b82bee4c433 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:46.132127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628f36e-a948-46ce-a275-2b82bee4c433 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:46.132441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628f36e-a948-46ce-a275-2b82bee4c433 None admin] PATH_INFO: `/v3/projects/8fe707b5cd024514adcff753659e32ea` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:46.133816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628f36e-a948-46ce-a275-2b82bee4c433 None admin] RBAC: Authorizing `identity:get_project(project_id=8fe707b5cd024514adcff753659e32ea)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:46.135329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628f36e-a948-46ce-a275-2b82bee4c433 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:46.137525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 90/179] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:45 2022] GET /identity/v3/projects/8fe707b5cd024514adcff753659e32ea => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:46.143152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49301048-f423-4cb5-92c7-74ab33258bde None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:46.162792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:46.256293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49301048-f423-4cb5-92c7-74ab33258bde None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:46.298634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e3edf-e4af-4124-8770-ccee719cad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:46.299354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e3edf-e4af-4124-8770-ccee719cad63 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:46.299647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e3edf-e4af-4124-8770-ccee719cad63 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:46.299932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e3edf-e4af-4124-8770-ccee719cad63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:46.300773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e3edf-e4af-4124-8770-ccee719cad63 None admin] RBAC: Adding query filter params (role.id=ec78785738f441ec9be64e122e252506, scope.project.id=8fe707b5cd024514adcff753659e32ea, user.id=a941a87e586f4f72ade6be453d0effa2) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:46.301090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e3edf-e4af-4124-8770-ccee719cad63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:46.302587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e3edf-e4af-4124-8770-ccee719cad63 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:46.308908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 90/180] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:46 2022] GET /identity/v3/role_assignments?user.id=a941a87e586f4f72ade6be453d0effa2&scope.project.id=8fe707b5cd024514adcff753659e32ea&role.id=ec78785738f441ec9be64e122e252506 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:47.218825 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25945-1720-4f2b-8a45-67188d93bed2 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.219822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25945-1720-4f2b-8a45-67188d93bed2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.220316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25945-1720-4f2b-8a45-67188d93bed2 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.221933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 91/181] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:47.228103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cc3aa-98ec-4a42-af4b-fb40879af5c9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.228941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cc3aa-98ec-4a42-af4b-fb40879af5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.229439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cc3aa-98ec-4a42-af4b-fb40879af5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.243974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3a1da-778e-4cb8-a606-18d6c1305f41 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.244276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3a1da-778e-4cb8-a606-18d6c1305f41 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.244536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3a1da-778e-4cb8-a606-18d6c1305f41 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.246155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 92/182] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:47.248576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-463cc3aa-98ec-4a42-af4b-fb40879af5c9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:47.249768 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-463cc3aa-98ec-4a42-af4b-fb40879af5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:47.253868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a201e-885f-4ee8-a3f7-3e7d0593f672 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.254469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a201e-885f-4ee8-a3f7-3e7d0593f672 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.254953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a201e-885f-4ee8-a3f7-3e7d0593f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.272652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-1c8a201e-885f-4ee8-a3f7-3e7d0593f672 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:47.274760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1c8a201e-885f-4ee8-a3f7-3e7d0593f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:47.323193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 91/183] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:47.331348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:47.348921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cc3aa-98ec-4a42-af4b-fb40879af5c9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:47.360095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:47.361074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 93/184] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:47.365455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f171-b3bf-48f5-95a7-8a71abe11082 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.365455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f171-b3bf-48f5-95a7-8a71abe11082 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.365455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f171-b3bf-48f5-95a7-8a71abe11082 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.365455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 94/185] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:47.370537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e91125-7746-484a-9cc8-12cdaae23567 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.370826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e91125-7746-484a-9cc8-12cdaae23567 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.372125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e91125-7746-484a-9cc8-12cdaae23567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.389989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-99e91125-7746-484a-9cc8-12cdaae23567 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:47.391389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-99e91125-7746-484a-9cc8-12cdaae23567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:47.462014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cc3aa-98ec-4a42-af4b-fb40879af5c9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:47.464089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 95/186] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:47.464938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e91125-7746-484a-9cc8-12cdaae23567 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:47.504286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e3da3-9471-4822-ab82-18c7a285dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:47.505086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3da3-9471-4822-ab82-18c7a285dd1c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.505369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3da3-9471-4822-ab82-18c7a285dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.505641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3da3-9471-4822-ab82-18c7a285dd1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.517075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e3da3-9471-4822-ab82-18c7a285dd1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-487e3da3-9471-4822-ab82-18c7a285dd1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:47.525349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:47.526259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 92/187] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:55:47.532137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e3da3-9471-4822-ab82-18c7a285dd1c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:47.577090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e91125-7746-484a-9cc8-12cdaae23567 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:47.584172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:47.599209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:47.612424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b8a3-cdb0-43d7-918e-e3fd68c3f743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:47.613216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b8a3-cdb0-43d7-918e-e3fd68c3f743 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.613510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b8a3-cdb0-43d7-918e-e3fd68c3f743 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.613783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616b8a3-cdb0-43d7-918e-e3fd68c3f743 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.614992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616b8a3-cdb0-43d7-918e-e3fd68c3f743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:47.616450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616b8a3-cdb0-43d7-918e-e3fd68c3f743 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:47.623244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 96/188] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:47.623949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b8a3-cdb0-43d7-918e-e3fd68c3f743 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:47.633200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e3da3-9471-4822-ab82-18c7a285dd1c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:47.668339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329d84-de5d-4867-a613-71556e34af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:47.669149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329d84-de5d-4867-a613-71556e34af37 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.669440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329d84-de5d-4867-a613-71556e34af37 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.669703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329d84-de5d-4867-a613-71556e34af37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.680462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c329d84-de5d-4867-a613-71556e34af37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1c329d84-de5d-4867-a613-71556e34af37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:47.688480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:47.689495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:47.690528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 93/189] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:55:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:47.694396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329d84-de5d-4867-a613-71556e34af37 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:47.731024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616b8a3-cdb0-43d7-918e-e3fd68c3f743 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:47.767092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:47.767825 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.768115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.768441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.769191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:47.769588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:47.771130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:47.779513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 97/190] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:47.784528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:47.807136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329d84-de5d-4867-a613-71556e34af37 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:47.823001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:47.834965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:47.842980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62cab1-40a7-4b67-804a-353fd816787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:47.843648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62cab1-40a7-4b67-804a-353fd816787d None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.843932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62cab1-40a7-4b67-804a-353fd816787d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.844208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62cab1-40a7-4b67-804a-353fd816787d None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.844913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62cab1-40a7-4b67-804a-353fd816787d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:47.846458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62cab1-40a7-4b67-804a-353fd816787d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:47.889935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e806132-697d-4610-bd24-5e19c4d424c9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:47.921837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:47.922524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:47.922813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:47.923097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:47.923844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:47.924153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:47.925537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:47.934182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 98/191] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:55:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:47.934976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:47.955612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 94/192] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:55:47 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:47.956578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62cab1-40a7-4b67-804a-353fd816787d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:48.072494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:48.078953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41daec-a196-40f2-896c-68df9a19e2c3 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:48.086144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62cab1-40a7-4b67-804a-353fd816787d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:48.132119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cfbb4-f0fd-4c90-b6d9-6e239b928ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:48.133109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cfbb4-f0fd-4c90-b6d9-6e239b928ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.133400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cfbb4-f0fd-4c90-b6d9-6e239b928ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.133680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cfbb4-f0fd-4c90-b6d9-6e239b928ea2 None admin] PATH_INFO: `/v3/users/93c5799a53434ac8834b0cd1047aad70` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.136817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad1d6-583b-4ec4-a525-e6c90904b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:48.136817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad1d6-583b-4ec4-a525-e6c90904b02e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.136817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad1d6-583b-4ec4-a525-e6c90904b02e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.136817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caad1d6-583b-4ec4-a525-e6c90904b02e None admin] PATH_INFO: `/v3/users/93c5799a53434ac8834b0cd1047aad70` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.154961 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cfbb4-f0fd-4c90-b6d9-6e239b928ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=93c5799a53434ac8834b0cd1047aad70)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:48.155420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad1d6-583b-4ec4-a525-e6c90904b02e None admin] RBAC: Authorizing `identity:get_user(user_id=93c5799a53434ac8834b0cd1047aad70)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:48.156475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cfbb4-f0fd-4c90-b6d9-6e239b928ea2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:48.157469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caad1d6-583b-4ec4-a525-e6c90904b02e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:48.158715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 99/193] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:47 2022] GET /identity/v3/users/93c5799a53434ac8834b0cd1047aad70 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:48.160105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 95/194] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:47 2022] GET /identity/v3/users/93c5799a53434ac8834b0cd1047aad70 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:48.166395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cfbb4-f0fd-4c90-b6d9-6e239b928ea2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:48.167836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad1d6-583b-4ec4-a525-e6c90904b02e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:48.223885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:48.293044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caad1d6-583b-4ec4-a525-e6c90904b02e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:48.296809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cfbb4-f0fd-4c90-b6d9-6e239b928ea2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:48.334637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58103a-d101-4202-a732-23d436fd5359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:48.335222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58103a-d101-4202-a732-23d436fd5359 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.336120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58103a-d101-4202-a732-23d436fd5359 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.336387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58103a-d101-4202-a732-23d436fd5359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.338029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e78ed-5ccc-4a91-a054-fdde6d9b4c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:48.338685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e78ed-5ccc-4a91-a054-fdde6d9b4c14 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.338967 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e78ed-5ccc-4a91-a054-fdde6d9b4c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.339243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e78ed-5ccc-4a91-a054-fdde6d9b4c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.374720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:48.425830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58103a-d101-4202-a732-23d436fd5359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:48.428425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58103a-d101-4202-a732-23d436fd5359 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:48.429655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e78ed-5ccc-4a91-a054-fdde6d9b4c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:48.431205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e78ed-5ccc-4a91-a054-fdde6d9b4c14 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:48.476644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:48.539821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 96/195] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:48.541192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee3b9a-6266-44b3-8c08-05cb4e23b090 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.541482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee3b9a-6266-44b3-8c08-05cb4e23b090 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.541764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee3b9a-6266-44b3-8c08-05cb4e23b090 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.543252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 97/196] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:48.549157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a972b-6949-485a-a75f-0eeffb6347d9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.549442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a972b-6949-485a-a75f-0eeffb6347d9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.549760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a972b-6949-485a-a75f-0eeffb6347d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.566360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 100/197] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:55:48.567216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e78ed-5ccc-4a91-a054-fdde6d9b4c14 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:48.573106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-897a972b-6949-485a-a75f-0eeffb6347d9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:48.574666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-897a972b-6949-485a-a75f-0eeffb6347d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:48.628916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:48.648421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 98/198] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:48.654890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a972b-6949-485a-a75f-0eeffb6347d9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:48.675324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e78ed-5ccc-4a91-a054-fdde6d9b4c14 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:48.711572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c4a1-aba4-4a5d-97bc-c71b4ef6eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:48.712636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c4a1-aba4-4a5d-97bc-c71b4ef6eced None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.713022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c4a1-aba4-4a5d-97bc-c71b4ef6eced None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.713398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c4a1-aba4-4a5d-97bc-c71b4ef6eced None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.714744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c4a1-aba4-4a5d-97bc-c71b4ef6eced None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:48.716327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c4a1-aba4-4a5d-97bc-c71b4ef6eced None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:48.718482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 101/199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:48 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:48.719358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c4a1-aba4-4a5d-97bc-c71b4ef6eced None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:48.774438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:48.786097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a972b-6949-485a-a75f-0eeffb6347d9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:48.823987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36177-372d-4793-9154-c2062d9420bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:48.824965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36177-372d-4793-9154-c2062d9420bc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.825261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36177-372d-4793-9154-c2062d9420bc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.825544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a36177-372d-4793-9154-c2062d9420bc None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.826785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a36177-372d-4793-9154-c2062d9420bc None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:48.828584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a36177-372d-4793-9154-c2062d9420bc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:48.830322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 99/200] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:48 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:48.831093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36177-372d-4793-9154-c2062d9420bc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:48.836643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c4a1-aba4-4a5d-97bc-c71b4ef6eced None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:48.861737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:48.878777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b6f1-351b-443a-b8a7-c01bbbff7778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:48.879747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b6f1-351b-443a-b8a7-c01bbbff7778 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.879983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b6f1-351b-443a-b8a7-c01bbbff7778 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.880268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b6f1-351b-443a-b8a7-c01bbbff7778 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.891806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44b6f1-351b-443a-b8a7-c01bbbff7778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-9e44b6f1-351b-443a-b8a7-c01bbbff7778 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:48.900781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:48.901670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:55:48.902997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:48.907132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 102/201] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:48.908034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b6f1-351b-443a-b8a7-c01bbbff7778 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:48.941232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a36177-372d-4793-9154-c2062d9420bc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:48.979556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:48.980224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:48.980633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:48.980920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:48.981885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] RBAC: Adding query filter params (role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f, user.id=93c5799a53434ac8834b0cd1047aad70) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:48.982231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:48.983698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:48.995593 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 100/202] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:48 2022] GET /identity/v3/role_assignments?user.id=93c5799a53434ac8834b0cd1047aad70&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:48.996562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:49.013489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:49.028862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b6f1-351b-443a-b8a7-c01bbbff7778 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:49.066852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:49.067529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:49.067872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:49.068160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:49.069020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f, user.id=93c5799a53434ac8834b0cd1047aad70) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:49.069340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:49.071421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:49.078598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 103/203] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:48 2022] GET /identity/v3/role_assignments?user.id=93c5799a53434ac8834b0cd1047aad70&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=f3f138e4021a4b7dada39089dd427266 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:49.195918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba8d9-9d6c-4716-aba5-7fe94e35aef4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:49.250990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:49.251691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:49.251977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:49.252258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:49.253055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:49.253366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:49.254932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:49.265653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 101/204] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:49.271305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:49.323842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:49.389099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb69195-4377-4d24-9c91-abf1aa162435 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:49.437118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24de87d-5ab7-4b24-9cf7-73927bb6a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:49.438057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24de87d-5ab7-4b24-9cf7-73927bb6a010 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:49.438348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24de87d-5ab7-4b24-9cf7-73927bb6a010 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:49.438629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24de87d-5ab7-4b24-9cf7-73927bb6a010 None admin] PATH_INFO: `/v3/users/57e531abe4c647a0b0304371ff9c81f2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:49.439864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24de87d-5ab7-4b24-9cf7-73927bb6a010 None admin] RBAC: Authorizing `identity:get_user(user_id=57e531abe4c647a0b0304371ff9c81f2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:49.441315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24de87d-5ab7-4b24-9cf7-73927bb6a010 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:49.442973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 104/205] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:49 2022] GET /identity/v3/users/57e531abe4c647a0b0304371ff9c81f2 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:49.449291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:49.537618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:49.578294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d3e5-6ce7-4300-a24d-71fb8248a398 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:49.613324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca42b1-ce1f-42cf-aaa4-5e031b9fcd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:49.614001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca42b1-ce1f-42cf-aaa4-5e031b9fcd06 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:49.614293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca42b1-ce1f-42cf-aaa4-5e031b9fcd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:49.614568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca42b1-ce1f-42cf-aaa4-5e031b9fcd06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:49.709514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca42b1-ce1f-42cf-aaa4-5e031b9fcd06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:49.710982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca42b1-ce1f-42cf-aaa4-5e031b9fcd06 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:49.806331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:49.855208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 102/206] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:49.860425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24de87d-5ab7-4b24-9cf7-73927bb6a010 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:50.004030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24de87d-5ab7-4b24-9cf7-73927bb6a010 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:50.025652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:50.043741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975b411-eaf3-48e8-87e0-9862cf8cb889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:50.044611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b411-eaf3-48e8-87e0-9862cf8cb889 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:50.044896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b411-eaf3-48e8-87e0-9862cf8cb889 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:50.050583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975b411-eaf3-48e8-87e0-9862cf8cb889 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:50.050583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975b411-eaf3-48e8-87e0-9862cf8cb889 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:50.050583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975b411-eaf3-48e8-87e0-9862cf8cb889 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:50.050583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 105/207] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:49 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:50.055622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca42b1-ce1f-42cf-aaa4-5e031b9fcd06 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:50.159053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca42b1-ce1f-42cf-aaa4-5e031b9fcd06 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:50.234294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856d348-a5ab-4e60-a6fa-89cfe367a19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:50.234952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856d348-a5ab-4e60-a6fa-89cfe367a19a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:50.235236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856d348-a5ab-4e60-a6fa-89cfe367a19a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:50.235511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856d348-a5ab-4e60-a6fa-89cfe367a19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:50.236342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856d348-a5ab-4e60-a6fa-89cfe367a19a None admin] RBAC: Adding query filter params (role.id=84808704b93544b6b353735cb3c5825f, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a, user.id=57e531abe4c647a0b0304371ff9c81f2) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:50.236650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856d348-a5ab-4e60-a6fa-89cfe367a19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:50.238135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856d348-a5ab-4e60-a6fa-89cfe367a19a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:50.246494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 103/208] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:50 2022] GET /identity/v3/role_assignments?user.id=57e531abe4c647a0b0304371ff9c81f2&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=84808704b93544b6b353735cb3c5825f => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:50.641115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8256678-8727-496d-84ed-0e5d500e2bc4 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:50.641647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8256678-8727-496d-84ed-0e5d500e2bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:50.641647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8256678-8727-496d-84ed-0e5d500e2bc4 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:50.643192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 106/209] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:50.649294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5616c3-0cfc-43e3-a87b-990e06abf781 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:50.650158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5616c3-0cfc-43e3-a87b-990e06abf781 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:50.650663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5616c3-0cfc-43e3-a87b-990e06abf781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:50.672295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6e5616c3-0cfc-43e3-a87b-990e06abf781 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:50.673816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6e5616c3-0cfc-43e3-a87b-990e06abf781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:50.710805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:50.769827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 104/210] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:50.796351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8256678-8727-496d-84ed-0e5d500e2bc4 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:50.915845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8256678-8727-496d-84ed-0e5d500e2bc4 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:50.951562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a2b3-c2c5-475a-93ac-2c32f7f04142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:50.952364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a2b3-c2c5-475a-93ac-2c32f7f04142 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:50.952650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a2b3-c2c5-475a-93ac-2c32f7f04142 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:50.952928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a2b3-c2c5-475a-93ac-2c32f7f04142 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:50.955255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1148953-a0ac-4542-97f1-639b242d0084 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:50.955545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1148953-a0ac-4542-97f1-639b242d0084 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:50.955822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1148953-a0ac-4542-97f1-639b242d0084 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:50.957202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 105/211] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:50.962758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156bbf2-b578-4638-97ef-0bd5e413aa5e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:50.963045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156bbf2-b578-4638-97ef-0bd5e413aa5e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:50.963490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156bbf2-b578-4638-97ef-0bd5e413aa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:50.969476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44a2b3-c2c5-475a-93ac-2c32f7f04142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-3b44a2b3-c2c5-475a-93ac-2c32f7f04142 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:50.978097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:50.978971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:50.979900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 107/212] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:50.986033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0156bbf2-b578-4638-97ef-0bd5e413aa5e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:50.986226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a2b3-c2c5-475a-93ac-2c32f7f04142 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:50.987223 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0156bbf2-b578-4638-97ef-0bd5e413aa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:51.035931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:51.075750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 106/213] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:51.102906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156bbf2-b578-4638-97ef-0bd5e413aa5e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:51.112031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a2b3-c2c5-475a-93ac-2c32f7f04142 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:51.149158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:51.149835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.150152 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.150439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.151195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:51.151506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:51.152909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:51.161538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 108/214] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:51.167058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:51.215908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:51.226373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156bbf2-b578-4638-97ef-0bd5e413aa5e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:51.262946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3dd31-bfb0-44da-9b02-291f384946e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:51.263923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3dd31-bfb0-44da-9b02-291f384946e0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.264311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3dd31-bfb0-44da-9b02-291f384946e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.264695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3dd31-bfb0-44da-9b02-291f384946e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.266029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3dd31-bfb0-44da-9b02-291f384946e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:51.267594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3dd31-bfb0-44da-9b02-291f384946e0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:51.274223 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 107/215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:51.275663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3dd31-bfb0-44da-9b02-291f384946e0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:51.302441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd121ea-f482-4f79-8c5d-92bd0914e4b9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:51.310170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:51.341527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5ec4-d970-4b9b-a029-ab4bd39bf0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:51.343094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5ec4-d970-4b9b-a029-ab4bd39bf0aa None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.343619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5ec4-d970-4b9b-a029-ab4bd39bf0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.344187 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5ec4-d970-4b9b-a029-ab4bd39bf0aa None admin] PATH_INFO: `/v3/users/84ec3c7a37724eabb8d5ddb9fb7681bc` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.359237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a5ec4-d970-4b9b-a029-ab4bd39bf0aa None admin] RBAC: Authorizing `identity:get_user(user_id=84ec3c7a37724eabb8d5ddb9fb7681bc)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:51.361250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a5ec4-d970-4b9b-a029-ab4bd39bf0aa None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:51.363376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 109/216] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:51 2022] GET /identity/v3/users/84ec3c7a37724eabb8d5ddb9fb7681bc => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:51.369611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5ec4-d970-4b9b-a029-ab4bd39bf0aa None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:51.383592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3dd31-bfb0-44da-9b02-291f384946e0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:51.420199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabee218-d6d8-44c5-b667-210a8a9a1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:51.420794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee218-d6d8-44c5-b667-210a8a9a1e90 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.421082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee218-d6d8-44c5-b667-210a8a9a1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.421361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee218-d6d8-44c5-b667-210a8a9a1e90 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.422246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabee218-d6d8-44c5-b667-210a8a9a1e90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:51.423810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabee218-d6d8-44c5-b667-210a8a9a1e90 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:51.486850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5ec4-d970-4b9b-a029-ab4bd39bf0aa None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:51.523623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568de798-56b6-4fe5-ba62-131e77ee74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:51.524281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568de798-56b6-4fe5-ba62-131e77ee74aa None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.524569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568de798-56b6-4fe5-ba62-131e77ee74aa None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.524849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568de798-56b6-4fe5-ba62-131e77ee74aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.545924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 108/217] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:55:51 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:51.588392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:51.613890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568de798-56b6-4fe5-ba62-131e77ee74aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:51.615475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568de798-56b6-4fe5-ba62-131e77ee74aa None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:51.731861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 110/218] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:55:51.737421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabee218-d6d8-44c5-b667-210a8a9a1e90 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:51.762780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:51.794660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59be0-bfbd-4018-8c1c-7b36bb860a84 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.795065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59be0-bfbd-4018-8c1c-7b36bb860a84 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.795222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a59be0-bfbd-4018-8c1c-7b36bb860a84 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.796770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 111/219] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:51.801942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d1c4-39a8-46e9-9bc6-35330f6a82a1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.802321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d1c4-39a8-46e9-9bc6-35330f6a82a1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.802611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d1c4-39a8-46e9-9bc6-35330f6a82a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.824028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ead0d1c4-39a8-46e9-9bc6-35330f6a82a1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:51.825542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ead0d1c4-39a8-46e9-9bc6-35330f6a82a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:51.870990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabee218-d6d8-44c5-b667-210a8a9a1e90 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:51.909787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:51.917490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fc18c-fc6c-41db-8d71-5a3b979b4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:51.918951 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc18c-fc6c-41db-8d71-5a3b979b4801 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.918951 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc18c-fc6c-41db-8d71-5a3b979b4801 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.919122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc18c-fc6c-41db-8d71-5a3b979b4801 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.925373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc18c-fc6c-41db-8d71-5a3b979b4801 None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:51.925373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc18c-fc6c-41db-8d71-5a3b979b4801 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:51.925373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 109/220] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:51 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:51.926127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 112/221] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:51.930326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fc18c-fc6c-41db-8d71-5a3b979b4801 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:51.941482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8bdbd-d000-45b7-8216-6887741faa93 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.941877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8bdbd-d000-45b7-8216-6887741faa93 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.942058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8bdbd-d000-45b7-8216-6887741faa93 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.943438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 113/222] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:51.949094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b5aa-f816-4903-94e4-4240733015ea None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:51.949383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b5aa-f816-4903-94e4-4240733015ea None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:51.949756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b5aa-f816-4903-94e4-4240733015ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:51.973943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-dff7b5aa-f816-4903-94e4-4240733015ea None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:51.975256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-dff7b5aa-f816-4903-94e4-4240733015ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:52.029287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:52.049432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fc18c-fc6c-41db-8d71-5a3b979b4801 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.072325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 114/223] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:52.073557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7b5aa-f816-4903-94e4-4240733015ea None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.087562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:52.088616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:52.089096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:52.089599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:52.090807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] RBAC: Adding query filter params (role.id=ec78785738f441ec9be64e122e252506, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f, user.id=84ec3c7a37724eabb8d5ddb9fb7681bc) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:52.091347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:52.093106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:52.099718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 110/224] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:51 2022] GET /identity/v3/role_assignments?user.id=84ec3c7a37724eabb8d5ddb9fb7681bc&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=ec78785738f441ec9be64e122e252506 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:52.112318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.199726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7b5aa-f816-4903-94e4-4240733015ea None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.229613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:52.243351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35412-519a-44f8-8752-9223128019b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:52.244304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35412-519a-44f8-8752-9223128019b9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:52.244708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35412-519a-44f8-8752-9223128019b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:52.245209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35412-519a-44f8-8752-9223128019b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:52.259230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a35412-519a-44f8-8752-9223128019b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-d1a35412-519a-44f8-8752-9223128019b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:52.269258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:52.270252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:52.271033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 115/225] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:52.280320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35412-519a-44f8-8752-9223128019b9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.336857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf23619-6187-4b1f-ac01-d5efb7938677 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.395141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35412-519a-44f8-8752-9223128019b9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.432294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:52.432978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:52.433269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:52.433557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:52.434228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b0a07-aa5d-4c18-9ebd-bfa2bd9164fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:52.434370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:52.434656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:52.435505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0a07-aa5d-4c18-9ebd-bfa2bd9164fd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:52.435923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0a07-aa5d-4c18-9ebd-bfa2bd9164fd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:52.436080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:52.436494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0a07-aa5d-4c18-9ebd-bfa2bd9164fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:52.445134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 116/226] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:52.450986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.459402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b0a07-aa5d-4c18-9ebd-bfa2bd9164fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-325b0a07-aa5d-4c18-9ebd-bfa2bd9164fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:52.469683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:52.470596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:52.471377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:52.471966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 111/227] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:55:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:55:52.477704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b0a07-aa5d-4c18-9ebd-bfa2bd9164fd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.487387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:52.501492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:52.588473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b0a07-aa5d-4c18-9ebd-bfa2bd9164fd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.604163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac66881-d944-4f6e-967b-697934811d16 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.625253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:52.626289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:52.626776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:52.627249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:52.628225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:52.628728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:52.630351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:52.640514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 112/228] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:55:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:52.646404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.686728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e19be7-fd73-45a7-b7c8-48899d11226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:52.687620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19be7-fd73-45a7-b7c8-48899d11226c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:52.687904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19be7-fd73-45a7-b7c8-48899d11226c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:52.688180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19be7-fd73-45a7-b7c8-48899d11226c None admin] PATH_INFO: `/v3/users/93c5799a53434ac8834b0cd1047aad70` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:52.695443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e19be7-fd73-45a7-b7c8-48899d11226c None admin] RBAC: Authorizing `identity:get_user(user_id=93c5799a53434ac8834b0cd1047aad70)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:52.696717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e19be7-fd73-45a7-b7c8-48899d11226c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:52.699027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 117/229] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:52 2022] GET /identity/v3/users/93c5799a53434ac8834b0cd1047aad70 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:52.704051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e19be7-fd73-45a7-b7c8-48899d11226c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.722356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:52.759539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65646b0-e28d-40ef-8c1e-6a311c640c85 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.797226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f803-2b75-4c32-bd8d-35759e685493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:52.798140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f803-2b75-4c32-bd8d-35759e685493 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:52.798572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f803-2b75-4c32-bd8d-35759e685493 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:52.798857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f803-2b75-4c32-bd8d-35759e685493 None admin] PATH_INFO: `/v3/users/93c5799a53434ac8834b0cd1047aad70` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:52.800347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8f803-2b75-4c32-bd8d-35759e685493 None admin] RBAC: Authorizing `identity:get_user(user_id=93c5799a53434ac8834b0cd1047aad70)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:52.801809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8f803-2b75-4c32-bd8d-35759e685493 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:52.803674 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 113/230] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:52 2022] GET /identity/v3/users/93c5799a53434ac8834b0cd1047aad70 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:52.814536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f803-2b75-4c32-bd8d-35759e685493 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.933675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e19be7-fd73-45a7-b7c8-48899d11226c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.934190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f803-2b75-4c32-bd8d-35759e685493 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:52.967156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:52.971846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c385e-f8ec-4d73-8cce-d8d92ebfc63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:52.972726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c385e-f8ec-4d73-8cce-d8d92ebfc63b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:52.973012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c385e-f8ec-4d73-8cce-d8d92ebfc63b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:52.973292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c385e-f8ec-4d73-8cce-d8d92ebfc63b None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:52.974510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c385e-f8ec-4d73-8cce-d8d92ebfc63b None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:52.976016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c385e-f8ec-4d73-8cce-d8d92ebfc63b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:52.977794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 114/231] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:52 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:52.983535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c385e-f8ec-4d73-8cce-d8d92ebfc63b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:52.987275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:53.030683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9bb17-6dea-48cc-bddb-83922b7bc198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:53.031573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9bb17-6dea-48cc-bddb-83922b7bc198 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:53.031858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9bb17-6dea-48cc-bddb-83922b7bc198 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:53.032136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9bb17-6dea-48cc-bddb-83922b7bc198 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:53.033372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9bb17-6dea-48cc-bddb-83922b7bc198 None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:53.034901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9bb17-6dea-48cc-bddb-83922b7bc198 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:53.037578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 118/232] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:52 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:53.042294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9bb17-6dea-48cc-bddb-83922b7bc198 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:53.097724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c385e-f8ec-4d73-8cce-d8d92ebfc63b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:53.161372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87d4f-568c-4329-a8fc-e67817781360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:53.165500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87d4f-568c-4329-a8fc-e67817781360 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:53.166071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87d4f-568c-4329-a8fc-e67817781360 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:53.166549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87d4f-568c-4329-a8fc-e67817781360 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/users/93c5799a53434ac8834b0cd1047aad70/roles/961dfd3ce0344659aaf2e9c80164893e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:53.170421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87d4f-568c-4329-a8fc-e67817781360 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f, user_id=93c5799a53434ac8834b0cd1047aad70, role_id=961dfd3ce0344659aaf2e9c80164893e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:53.173400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87d4f-568c-4329-a8fc-e67817781360 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:53.225069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9bb17-6dea-48cc-bddb-83922b7bc198 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:53.242174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 115/233] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:55:52 2022] PUT /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/users/93c5799a53434ac8834b0cd1047aad70/roles/961dfd3ce0344659aaf2e9c80164893e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:55:53.280395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4068cf6-5999-47db-a7a2-998e2ff322d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:53.281711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4068cf6-5999-47db-a7a2-998e2ff322d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:53.282279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4068cf6-5999-47db-a7a2-998e2ff322d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:53.282773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4068cf6-5999-47db-a7a2-998e2ff322d2 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/users/93c5799a53434ac8834b0cd1047aad70/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:53.287495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4068cf6-5999-47db-a7a2-998e2ff322d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f, user_id=93c5799a53434ac8834b0cd1047aad70, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:53.289830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4068cf6-5999-47db-a7a2-998e2ff322d2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:53.405408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 119/234] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:55:53 2022] PUT /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/users/93c5799a53434ac8834b0cd1047aad70/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:55:54.418042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951a569-fdb9-4d81-b8d2-2daca299b70c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:54.419049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951a569-fdb9-4d81-b8d2-2daca299b70c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:54.419537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951a569-fdb9-4d81-b8d2-2daca299b70c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:54.421115 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 116/235] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:54.426651 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192339-5f70-4975-bbd0-0345213738b3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:54.427478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192339-5f70-4975-bbd0-0345213738b3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:54.427953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e192339-5f70-4975-bbd0-0345213738b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:54.452864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8e192339-5f70-4975-bbd0-0345213738b3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:54.454399 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8e192339-5f70-4975-bbd0-0345213738b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:54.511999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:54.555873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 120/236] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:54.593352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d7ff-5a60-4db9-a28e-d39779eaa625 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:54.593639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d7ff-5a60-4db9-a28e-d39779eaa625 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:54.593929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d7ff-5a60-4db9-a28e-d39779eaa625 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:54.595359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 117/237] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:54.597440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e192339-5f70-4975-bbd0-0345213738b3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:54.600290 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5edfcb-f36e-4826-b167-7e9dc18e1b38 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:54.600587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5edfcb-f36e-4826-b167-7e9dc18e1b38 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:54.600912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5edfcb-f36e-4826-b167-7e9dc18e1b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:54.625269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9a5edfcb-f36e-4826-b167-7e9dc18e1b38 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:54.626491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9a5edfcb-f36e-4826-b167-7e9dc18e1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:54.709972 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:54.718649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 118/238] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:54.746410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5edfcb-f36e-4826-b167-7e9dc18e1b38 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:54.809609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e192339-5f70-4975-bbd0-0345213738b3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:54.851509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80801ed6-3061-413a-880f-771d8abb5f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:54.852339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80801ed6-3061-413a-880f-771d8abb5f61 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:54.852628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80801ed6-3061-413a-880f-771d8abb5f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:54.852912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80801ed6-3061-413a-880f-771d8abb5f61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:54.854929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80801ed6-3061-413a-880f-771d8abb5f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:54.856728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80801ed6-3061-413a-880f-771d8abb5f61 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:54.859387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 121/239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:54.860843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa5c8-e45c-467f-80b5-7a04a3c1dcd0 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:54.861137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa5c8-e45c-467f-80b5-7a04a3c1dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:54.861419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffa5c8-e45c-467f-80b5-7a04a3c1dcd0 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:54.863947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 122/240] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:54.865501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffa5c8-e45c-467f-80b5-7a04a3c1dcd0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:54.871621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5edfcb-f36e-4826-b167-7e9dc18e1b38 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:54.917130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:54.920194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad302e99-1fae-4d35-9460-2af061f84a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:54.920998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302e99-1fae-4d35-9460-2af061f84a6c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:54.921286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302e99-1fae-4d35-9460-2af061f84a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:54.921759 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302e99-1fae-4d35-9460-2af061f84a6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:54.936173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad302e99-1fae-4d35-9460-2af061f84a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ad302e99-1fae-4d35-9460-2af061f84a6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:54.946534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:54.947718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:55:54.948504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:54.953798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 119/241] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:54.953798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e64e1-6f65-453b-aaf0-2e6057f6daac None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:54.953798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e64e1-6f65-453b-aaf0-2e6057f6daac None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:54.953798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e64e1-6f65-453b-aaf0-2e6057f6daac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:54.971434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f96e64e1-6f65-453b-aaf0-2e6057f6daac None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:54.972689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f96e64e1-6f65-453b-aaf0-2e6057f6daac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:54.987407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffa5c8-e45c-467f-80b5-7a04a3c1dcd0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:55.029253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997ded-f492-4458-8fbb-a6040154e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:55.030170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997ded-f492-4458-8fbb-a6040154e670 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:55.030556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997ded-f492-4458-8fbb-a6040154e670 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:55.030982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58997ded-f492-4458-8fbb-a6040154e670 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:55.031844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997ded-f492-4458-8fbb-a6040154e670 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:55.033378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58997ded-f492-4458-8fbb-a6040154e670 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:55.036280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:55.056697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 120/242] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:55.057599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e64e1-6f65-453b-aaf0-2e6057f6daac None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:55.126385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 123/243] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:55:54 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:55.127327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997ded-f492-4458-8fbb-a6040154e670 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:55.180302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e64e1-6f65-453b-aaf0-2e6057f6daac None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:55.230936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:55.232719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:55.234033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:55.234763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:55.238204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:55.238700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:55.242794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:55.270256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 121/244] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:55.286283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:55.375341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:55.384471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58997ded-f492-4458-8fbb-a6040154e670 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:55.398363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:55.426876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3219fa0-1a53-4dad-bb8d-bebe611021ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:55.429375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3219fa0-1a53-4dad-bb8d-bebe611021ff None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:55.429887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3219fa0-1a53-4dad-bb8d-bebe611021ff None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:55.430520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3219fa0-1a53-4dad-bb8d-bebe611021ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:55.442661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da5f1d-8eba-4230-a9ed-c8420394f194 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:55.448482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3219fa0-1a53-4dad-bb8d-bebe611021ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-e3219fa0-1a53-4dad-bb8d-bebe611021ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:55.459308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:55.460293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:55.461107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:55.463511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 124/245] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:55.469378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3219fa0-1a53-4dad-bb8d-bebe611021ff None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:55.487431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c774f9-92d6-4892-9f3c-f23fa074f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:55.489444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c774f9-92d6-4892-9f3c-f23fa074f550 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:55.489444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c774f9-92d6-4892-9f3c-f23fa074f550 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:55.489444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c774f9-92d6-4892-9f3c-f23fa074f550 None admin] PATH_INFO: `/v3/users/5ed8839ed6a2488a86ef46d3f2fef578` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:55.505218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c774f9-92d6-4892-9f3c-f23fa074f550 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed8839ed6a2488a86ef46d3f2fef578)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:55.506876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c774f9-92d6-4892-9f3c-f23fa074f550 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:55.508757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 122/246] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:55 2022] GET /identity/v3/users/5ed8839ed6a2488a86ef46d3f2fef578 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:55.514381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c774f9-92d6-4892-9f3c-f23fa074f550 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:55.586758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3219fa0-1a53-4dad-bb8d-bebe611021ff None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:55.624444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c774f9-92d6-4892-9f3c-f23fa074f550 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:55.625192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:55.626199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:55.626666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:55.627126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:55.627228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:55.628550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:55.629062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:55.630710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:55.641210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 125/247] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:55.647140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:55.665413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9714e5-f46a-49d1-baa5-218b2788dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:55.666119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9714e5-f46a-49d1-baa5-218b2788dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:55.666461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9714e5-f46a-49d1-baa5-218b2788dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:55.666747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9714e5-f46a-49d1-baa5-218b2788dbc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:55.678433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:55.761275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9714e5-f46a-49d1-baa5-218b2788dbc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:55.762811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9714e5-f46a-49d1-baa5-218b2788dbc5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:55.772210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a12c-67fc-46f2-b336-f701167779e6 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:55.810887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17a87-e099-46d2-80d8-c6d70a6ab8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:55.812119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17a87-e099-46d2-80d8-c6d70a6ab8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:55.812631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17a87-e099-46d2-80d8-c6d70a6ab8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:55.813215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17a87-e099-46d2-80d8-c6d70a6ab8e7 None admin] PATH_INFO: `/v3/users/84ec3c7a37724eabb8d5ddb9fb7681bc` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:55.814774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e17a87-e099-46d2-80d8-c6d70a6ab8e7 None admin] RBAC: Authorizing `identity:get_user(user_id=84ec3c7a37724eabb8d5ddb9fb7681bc)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:55.816573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e17a87-e099-46d2-80d8-c6d70a6ab8e7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:55.819849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 126/248] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:55 2022] GET /identity/v3/users/84ec3c7a37724eabb8d5ddb9fb7681bc => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:55.826060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17a87-e099-46d2-80d8-c6d70a6ab8e7 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:55.888451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 123/249] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:55.894205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9714e5-f46a-49d1-baa5-218b2788dbc5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:55.911034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:55.939532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:55.959274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17a87-e099-46d2-80d8-c6d70a6ab8e7 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:56.014403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b31e1-97dd-4aa8-93ae-725e7faeaddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:56.015203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b31e1-97dd-4aa8-93ae-725e7faeaddf None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.019055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b31e1-97dd-4aa8-93ae-725e7faeaddf None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.019358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b31e1-97dd-4aa8-93ae-725e7faeaddf None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.020602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b31e1-97dd-4aa8-93ae-725e7faeaddf None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:56.022104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b31e1-97dd-4aa8-93ae-725e7faeaddf None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:56.029731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 127/250] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:55 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:56.051850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b31e1-97dd-4aa8-93ae-725e7faeaddf None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:56.090635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9714e5-f46a-49d1-baa5-218b2788dbc5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:56.137558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a5c3-ca22-488f-a0d4-c3166049c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:56.138462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a5c3-ca22-488f-a0d4-c3166049c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.138745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a5c3-ca22-488f-a0d4-c3166049c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.139016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a5c3-ca22-488f-a0d4-c3166049c3f8 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.140301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6a5c3-ca22-488f-a0d4-c3166049c3f8 None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:56.141858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6a5c3-ca22-488f-a0d4-c3166049c3f8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:56.143877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 124/251] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:55 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:56.145148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581301b-77a3-4bc1-996b-fb1bba0c8e4c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.145436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581301b-77a3-4bc1-996b-fb1bba0c8e4c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.145712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581301b-77a3-4bc1-996b-fb1bba0c8e4c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.147282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 125/252] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:56.149249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6a8bc-834e-46aa-bc78-b206adfccd64 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.149595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6a8bc-834e-46aa-bc78-b206adfccd64 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.149949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6a8bc-834e-46aa-bc78-b206adfccd64 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.152816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 126/253] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:56.153898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6a8bc-834e-46aa-bc78-b206adfccd64 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:56.204542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b31e1-97dd-4aa8-93ae-725e7faeaddf None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:56.239231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:56.252050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9da9-f3e7-4deb-b285-ee3eba425aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:56.253211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9da9-f3e7-4deb-b285-ee3eba425aa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.253501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9da9-f3e7-4deb-b285-ee3eba425aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.253938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9da9-f3e7-4deb-b285-ee3eba425aa7 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/users/84ec3c7a37724eabb8d5ddb9fb7681bc/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.256318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d9da9-f3e7-4deb-b285-ee3eba425aa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f, user_id=84ec3c7a37724eabb8d5ddb9fb7681bc, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:56.258908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d9da9-f3e7-4deb-b285-ee3eba425aa7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:56.277773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6a8bc-834e-46aa-bc78-b206adfccd64 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:56.309273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6f789-5dc2-485e-bd5e-c257d081af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:56.309952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6f789-5dc2-485e-bd5e-c257d081af05 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.310284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6f789-5dc2-485e-bd5e-c257d081af05 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.310557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6f789-5dc2-485e-bd5e-c257d081af05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.311386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6f789-5dc2-485e-bd5e-c257d081af05 None admin] RBAC: Adding query filter params (role.id=84808704b93544b6b353735cb3c5825f, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f, user.id=5ed8839ed6a2488a86ef46d3f2fef578) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:56.311693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6f789-5dc2-485e-bd5e-c257d081af05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:56.313290 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6f789-5dc2-485e-bd5e-c257d081af05 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:56.325895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 127/254] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:56 2022] GET /identity/v3/role_assignments?user.id=5ed8839ed6a2488a86ef46d3f2fef578&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=84808704b93544b6b353735cb3c5825f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:56.325895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b95c9-73fe-42cb-a502-d8f408ab5122 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.325895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b95c9-73fe-42cb-a502-d8f408ab5122 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.325895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b95c9-73fe-42cb-a502-d8f408ab5122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.332508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 128/255] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:55:56 2022] PUT /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/users/84ec3c7a37724eabb8d5ddb9fb7681bc/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:55:56.334063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11a03-70fa-496f-9e95-5919822129e1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.334361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11a03-70fa-496f-9e95-5919822129e1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.334643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11a03-70fa-496f-9e95-5919822129e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.364444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-79d11a03-70fa-496f-9e95-5919822129e1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:56.365912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-79d11a03-70fa-496f-9e95-5919822129e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:56.371185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-da1b95c9-73fe-42cb-a502-d8f408ab5122 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:56.372408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-da1b95c9-73fe-42cb-a502-d8f408ab5122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:56.377657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:56.475717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 129/256] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:56.516200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d11a03-70fa-496f-9e95-5919822129e1 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:56.566191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 128/257] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:56.607045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b95c9-73fe-42cb-a502-d8f408ab5122 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:56.650640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d11a03-70fa-496f-9e95-5919822129e1 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:56.690776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20f775-e8fd-47c7-b9d7-8cde21a1998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:56.691980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20f775-e8fd-47c7-b9d7-8cde21a1998c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.692499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20f775-e8fd-47c7-b9d7-8cde21a1998c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.692950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20f775-e8fd-47c7-b9d7-8cde21a1998c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.706716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20f775-e8fd-47c7-b9d7-8cde21a1998c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-ca20f775-e8fd-47c7-b9d7-8cde21a1998c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:56.715562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:56.716472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:55:56.717264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:56.724076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 130/258] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:55:56.726402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20f775-e8fd-47c7-b9d7-8cde21a1998c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:56.730998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:56.809617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:56.826368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b95c9-73fe-42cb-a502-d8f408ab5122 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:56.854904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20f775-e8fd-47c7-b9d7-8cde21a1998c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:56.894270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:56.894948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.895233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.895510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.896272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:56.896581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:56.898038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:56.908221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 131/259] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:56.912192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be8e6-4133-4cb8-91bf-29ac5bd579a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:56.912977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be8e6-4133-4cb8-91bf-29ac5bd579a4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:56.913304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be8e6-4133-4cb8-91bf-29ac5bd579a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:56.914278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:56.915246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be8e6-4133-4cb8-91bf-29ac5bd579a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:56.942895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30be8e6-4133-4cb8-91bf-29ac5bd579a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c30be8e6-4133-4cb8-91bf-29ac5bd579a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:56.959180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:56.960222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:55:56.961023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 129/260] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:55:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:56.966135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be8e6-4133-4cb8-91bf-29ac5bd579a4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:57.004366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:57.043272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e18bc1-b91d-4d01-8683-5100150ae125 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:57.082278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5680-30f8-4c11-95f0-1fac6bd75268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:57.084294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5680-30f8-4c11-95f0-1fac6bd75268 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:57.086070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5680-30f8-4c11-95f0-1fac6bd75268 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:57.086367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5680-30f8-4c11-95f0-1fac6bd75268 None admin] PATH_INFO: `/v3/users/93c5799a53434ac8834b0cd1047aad70` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:57.088068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5680-30f8-4c11-95f0-1fac6bd75268 None admin] RBAC: Authorizing `identity:get_user(user_id=93c5799a53434ac8834b0cd1047aad70)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:57.089579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5680-30f8-4c11-95f0-1fac6bd75268 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:57.091799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 132/261] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:56 2022] GET /identity/v3/users/93c5799a53434ac8834b0cd1047aad70 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:57.103317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5680-30f8-4c11-95f0-1fac6bd75268 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:57.188807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be8e6-4133-4cb8-91bf-29ac5bd579a4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:57.225994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:57.241944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:57.242640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:57.242922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:57.243368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:57.244135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:57.244443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:57.245836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:57.262191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 130/262] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:55:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:57.267201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:57.296080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5680-30f8-4c11-95f0-1fac6bd75268 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:57.357059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6064df-efc9-4943-a6ea-a2fc28e82a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:57.357949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6064df-efc9-4943-a6ea-a2fc28e82a77 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:57.358413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6064df-efc9-4943-a6ea-a2fc28e82a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:57.358837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6064df-efc9-4943-a6ea-a2fc28e82a77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:57.363880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:57.386944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb23d-b913-4a2d-a5ad-f31ea362a4a8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:57.423103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e1d4-e8e8-4294-945b-e681cf95148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:57.423979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e1d4-e8e8-4294-945b-e681cf95148b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:57.424259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e1d4-e8e8-4294-945b-e681cf95148b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:57.424534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e1d4-e8e8-4294-945b-e681cf95148b None admin] PATH_INFO: `/v3/users/93c5799a53434ac8834b0cd1047aad70` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:57.425735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053e1d4-e8e8-4294-945b-e681cf95148b None admin] RBAC: Authorizing `identity:get_user(user_id=93c5799a53434ac8834b0cd1047aad70)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:57.427500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053e1d4-e8e8-4294-945b-e681cf95148b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:57.430007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 131/263] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:57 2022] GET /identity/v3/users/93c5799a53434ac8834b0cd1047aad70 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:57.438850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e1d4-e8e8-4294-945b-e681cf95148b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:57.504839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6064df-efc9-4943-a6ea-a2fc28e82a77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:57.508201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6064df-efc9-4943-a6ea-a2fc28e82a77 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:57.564346 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:57.653906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e1d4-e8e8-4294-945b-e681cf95148b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:57.699194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 133/264] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:57.705334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6064df-efc9-4943-a6ea-a2fc28e82a77 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:57.732757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a175a52-1295-4bab-ba09-44c537770587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:57.733429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175a52-1295-4bab-ba09-44c537770587 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:57.733718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175a52-1295-4bab-ba09-44c537770587 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:57.734135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175a52-1295-4bab-ba09-44c537770587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:57.766091 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:57.892188 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175a52-1295-4bab-ba09-44c537770587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:57.893671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175a52-1295-4bab-ba09-44c537770587 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:57.908110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6064df-efc9-4943-a6ea-a2fc28e82a77 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:57.998686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafe62b-e7ac-4b0d-8acf-893e8237a59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:57.999935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafe62b-e7ac-4b0d-8acf-893e8237a59d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:58.000413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafe62b-e7ac-4b0d-8acf-893e8237a59d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:58.000881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafe62b-e7ac-4b0d-8acf-893e8237a59d None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:58.002392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafe62b-e7ac-4b0d-8acf-893e8237a59d None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:58.004079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafe62b-e7ac-4b0d-8acf-893e8237a59d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:58.006188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 134/265] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:57 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:58.011579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:58.012470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafe62b-e7ac-4b0d-8acf-893e8237a59d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:58.107328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 132/266] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:55:58.112644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a175a52-1295-4bab-ba09-44c537770587 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:58.253712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafe62b-e7ac-4b0d-8acf-893e8237a59d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:58.255746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:58.308781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a175a52-1295-4bab-ba09-44c537770587 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:58.339965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:58.340633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:58.340917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:58.341192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:58.342053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f, user.id=93c5799a53434ac8834b0cd1047aad70) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:58.342367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:58.343812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:58.360038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 135/267] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:58 2022] GET /identity/v3/role_assignments?user.id=93c5799a53434ac8834b0cd1047aad70&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=f3f138e4021a4b7dada39089dd427266 => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:58.384563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc04d13-d20a-4a88-8707-e7ec9a061198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:58.385470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc04d13-d20a-4a88-8707-e7ec9a061198 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:58.385757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc04d13-d20a-4a88-8707-e7ec9a061198 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:58.386070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc04d13-d20a-4a88-8707-e7ec9a061198 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:58.390703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc04d13-d20a-4a88-8707-e7ec9a061198 None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:58.392207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc04d13-d20a-4a88-8707-e7ec9a061198 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:58.394224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 133/268] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:55:58 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:55:58.400509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:58.582147 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f1fea-d093-4699-bef4-7117a2bf2bab None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:58.634789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bf83a-ad95-491c-9ff8-f45f7811790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:58.635463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf83a-ad95-491c-9ff8-f45f7811790c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:58.635749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf83a-ad95-491c-9ff8-f45f7811790c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:58.636023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bf83a-ad95-491c-9ff8-f45f7811790c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:58.636864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bf83a-ad95-491c-9ff8-f45f7811790c None admin] RBAC: Adding query filter params (role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f, user.id=93c5799a53434ac8834b0cd1047aad70) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:58.637173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bf83a-ad95-491c-9ff8-f45f7811790c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:58.638662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bf83a-ad95-491c-9ff8-f45f7811790c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:58.645532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 136/269] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:55:58 2022] GET /identity/v3/role_assignments?user.id=93c5799a53434ac8834b0cd1047aad70&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:59.105494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196591-527a-45af-8ed2-31c64fad2fcf None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.106046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196591-527a-45af-8ed2-31c64fad2fcf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.106126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196591-527a-45af-8ed2-31c64fad2fcf None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.107746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 134/270] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:59.112842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7db2f-4004-4e39-9e5c-1514341c0b9b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.113136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7db2f-4004-4e39-9e5c-1514341c0b9b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.113418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7db2f-4004-4e39-9e5c-1514341c0b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.133926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-bdd7db2f-4004-4e39-9e5c-1514341c0b9b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:59.135165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bdd7db2f-4004-4e39-9e5c-1514341c0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:59.151051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f075f-8a00-4eff-ac49-6d4d2f492d5a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.151355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f075f-8a00-4eff-ac49-6d4d2f492d5a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.151618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f075f-8a00-4eff-ac49-6d4d2f492d5a None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.153325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 135/271] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:59.158839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f481-3ddc-49ac-b3c0-37efc13b9c23 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.159127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f481-3ddc-49ac-b3c0-37efc13b9c23 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.159409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f481-3ddc-49ac-b3c0-37efc13b9c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.168719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:59.179488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bcf9f481-3ddc-49ac-b3c0-37efc13b9c23 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:59.180691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bcf9f481-3ddc-49ac-b3c0-37efc13b9c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:59.215219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:59.234587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 137/272] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:59.266070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7db2f-4004-4e39-9e5c-1514341c0b9b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:59.281220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 136/273] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:59.292172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7f07b-6f26-4bb1-9e92-a1e4c95bb83f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.292471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7f07b-6f26-4bb1-9e92-a1e4c95bb83f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.292757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7f07b-6f26-4bb1-9e92-a1e4c95bb83f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.294171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 137/274] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:55:59.304130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f3e16-b722-4079-a945-9a8617c66263 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.304336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f3e16-b722-4079-a945-9a8617c66263 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.304620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f3e16-b722-4079-a945-9a8617c66263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.329633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-366f3e16-b722-4079-a945-9a8617c66263 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:59.330876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-366f3e16-b722-4079-a945-9a8617c66263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:59.380884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7db2f-4004-4e39-9e5c-1514341c0b9b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:59.402699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 138/275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:55:59.403679 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f3e16-b722-4079-a945-9a8617c66263 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:59.424165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f4759-94fd-4145-9cfb-79c6e2de00b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:59.425513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4759-94fd-4145-9cfb-79c6e2de00b9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.426040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4759-94fd-4145-9cfb-79c6e2de00b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.426624 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4759-94fd-4145-9cfb-79c6e2de00b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.437727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f4759-94fd-4145-9cfb-79c6e2de00b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-eb6f4759-94fd-4145-9cfb-79c6e2de00b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:59.446042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:59.446952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:59.448017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:59.450118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 138/276] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:55:59.450940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f4759-94fd-4145-9cfb-79c6e2de00b9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:59.472451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:59.492166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:59.508345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f3e16-b722-4079-a945-9a8617c66263 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:59.542399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427c428-c4ad-477e-87be-e9873d8a10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:59.543189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c428-c4ad-477e-87be-e9873d8a10ac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.543480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c428-c4ad-477e-87be-e9873d8a10ac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.543754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c428-c4ad-477e-87be-e9873d8a10ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.544920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427c428-c4ad-477e-87be-e9873d8a10ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:59.546433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427c428-c4ad-477e-87be-e9873d8a10ac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:59.548044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 139/277] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:55:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:59.549214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e6b85-b787-4ba0-9062-c7a367e136c4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.549503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e6b85-b787-4ba0-9062-c7a367e136c4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.549782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e6b85-b787-4ba0-9062-c7a367e136c4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.551044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 140/278] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:55:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:55:59.551750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e6b85-b787-4ba0-9062-c7a367e136c4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:59.553312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f4759-94fd-4145-9cfb-79c6e2de00b9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:59.587923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8cbcf-819f-492c-9364-5818978bbc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:59.588715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8cbcf-819f-492c-9364-5818978bbc9e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.589004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8cbcf-819f-492c-9364-5818978bbc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.589287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8cbcf-819f-492c-9364-5818978bbc9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.599189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8cbcf-819f-492c-9364-5818978bbc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-19e8cbcf-819f-492c-9364-5818978bbc9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:55:59.606957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:55:59.607854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:55:59.608668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 139/279] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:55:59.609310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8cbcf-819f-492c-9364-5818978bbc9e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:59.654708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e6b85-b787-4ba0-9062-c7a367e136c4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:59.688215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee849f5-9f48-40f3-bb3a-8942b10991eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:59.688890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee849f5-9f48-40f3-bb3a-8942b10991eb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.689165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee849f5-9f48-40f3-bb3a-8942b10991eb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.689446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee849f5-9f48-40f3-bb3a-8942b10991eb None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.690231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee849f5-9f48-40f3-bb3a-8942b10991eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:59.690542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee849f5-9f48-40f3-bb3a-8942b10991eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:59.691925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee849f5-9f48-40f3-bb3a-8942b10991eb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:59.692691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:59.700883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 141/280] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:59.705310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb46501-2d0b-4878-a2a3-b82674c58609 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.705310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb46501-2d0b-4878-a2a3-b82674c58609 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.705310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb46501-2d0b-4878-a2a3-b82674c58609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.712098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8cbcf-819f-492c-9364-5818978bbc9e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:59.718635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cbb46501-2d0b-4878-a2a3-b82674c58609 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:55:59.719929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cbb46501-2d0b-4878-a2a3-b82674c58609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:55:59.729541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:59.746250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdae36d-84f7-46e1-9cbe-b4ae122e79e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:59.746923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae36d-84f7-46e1-9cbe-b4ae122e79e9 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.747212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae36d-84f7-46e1-9cbe-b4ae122e79e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.747514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdae36d-84f7-46e1-9cbe-b4ae122e79e9 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.748187 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdae36d-84f7-46e1-9cbe-b4ae122e79e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:59.749660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdae36d-84f7-46e1-9cbe-b4ae122e79e9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:59.788011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 142/281] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:55:59.788840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb46501-2d0b-4878-a2a3-b82674c58609 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:59.828232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 140/282] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:55:59 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:55:59.828232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdae36d-84f7-46e1-9cbe-b4ae122e79e9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:59.907869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb46501-2d0b-4878-a2a3-b82674c58609 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:59.932562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdae36d-84f7-46e1-9cbe-b4ae122e79e9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:55:59.947776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:59.948460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.948753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.949031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.949799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:55:59.950160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:59.951585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:55:59.960846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 143/283] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:55:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:55:59.961786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:55:59.971879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:59.977775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3ee-96d6-44c0-8aa3-390760ab4dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:55:59.978623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3ee-96d6-44c0-8aa3-390760ab4dcc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:55:59.978912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3ee-96d6-44c0-8aa3-390760ab4dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:55:59.979192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3ee-96d6-44c0-8aa3-390760ab4dcc None admin] PATH_INFO: `/v3/users/61fdb3b1f08241df9e270bda4403014a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:55:59.983208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:55:59.995321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a3ee-96d6-44c0-8aa3-390760ab4dcc None admin] RBAC: Authorizing `identity:get_user(user_id=61fdb3b1f08241df9e270bda4403014a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:55:59.996829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a3ee-96d6-44c0-8aa3-390760ab4dcc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:00.003450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 141/284] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:59 2022] GET /identity/v3/users/61fdb3b1f08241df9e270bda4403014a => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:00.003450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3ee-96d6-44c0-8aa3-390760ab4dcc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:00.094993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70317d7c-0bd0-4ab5-ae3f-34d11905cb1e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:00.122440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3ee-96d6-44c0-8aa3-390760ab4dcc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:00.133903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9755b1a-9d22-496e-bc2c-275c88e490dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:00.134745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755b1a-9d22-496e-bc2c-275c88e490dd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:00.135218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755b1a-9d22-496e-bc2c-275c88e490dd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:00.135321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755b1a-9d22-496e-bc2c-275c88e490dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:00.147853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9755b1a-9d22-496e-bc2c-275c88e490dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c9755b1a-9d22-496e-bc2c-275c88e490dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:00.157167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:00.163563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 144/285] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:55:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:00.164453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9755b1a-9d22-496e-bc2c-275c88e490dd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:00.165145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb40a8-22c8-451a-8d72-943ca39cdf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:00.165145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb40a8-22c8-451a-8d72-943ca39cdf10 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:00.165145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb40a8-22c8-451a-8d72-943ca39cdf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:00.165145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb40a8-22c8-451a-8d72-943ca39cdf10 None admin] PATH_INFO: `/v3/users/84ec3c7a37724eabb8d5ddb9fb7681bc` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:00.165395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb40a8-22c8-451a-8d72-943ca39cdf10 None admin] RBAC: Authorizing `identity:get_user(user_id=84ec3c7a37724eabb8d5ddb9fb7681bc)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:00.165395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb40a8-22c8-451a-8d72-943ca39cdf10 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:00.166700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 142/286] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:55:59 2022] GET /identity/v3/users/84ec3c7a37724eabb8d5ddb9fb7681bc => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:00.167478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb40a8-22c8-451a-8d72-943ca39cdf10 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:00.246871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:00.250125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:00.284221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9755b1a-9d22-496e-bc2c-275c88e490dd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:00.300546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb40a8-22c8-451a-8d72-943ca39cdf10 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:00.322421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:00.323235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:00.323590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:00.324005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:00.324913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] RBAC: Adding query filter params (role.id=ec78785738f441ec9be64e122e252506, user.id=61fdb3b1f08241df9e270bda4403014a, scope.system=all) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:00.325299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:00.326934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:00.332676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 145/287] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 30 11:56:00 2022] GET /identity/v3/role_assignments?user.id=61fdb3b1f08241df9e270bda4403014a&scope.system=all&role.id=ec78785738f441ec9be64e122e252506 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:00.333616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:00.352690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:00.353389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:00.354730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:00.355106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:00.355905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:00.356219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:00.358907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:00.380603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 143/288] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:00.386204 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:00.535697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9a5c7-a581-4bd7-b5a1-411e50c13337 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:00.573219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:00.576366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1ba41-f47d-4e9a-be13-b1812c364468 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:00.588317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cab5c4-37ac-4aee-b795-6f8688caa613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:00.588982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cab5c4-37ac-4aee-b795-6f8688caa613 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:00.589270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cab5c4-37ac-4aee-b795-6f8688caa613 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:00.589551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cab5c4-37ac-4aee-b795-6f8688caa613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:00.623883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:00.643198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba603c1-ee0b-48df-acb0-918ce5105a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:00.644094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba603c1-ee0b-48df-acb0-918ce5105a1e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:00.644382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba603c1-ee0b-48df-acb0-918ce5105a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:00.644664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba603c1-ee0b-48df-acb0-918ce5105a1e None admin] PATH_INFO: `/v3/users/5ed8839ed6a2488a86ef46d3f2fef578` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:00.650468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba603c1-ee0b-48df-acb0-918ce5105a1e None admin] RBAC: Authorizing `identity:get_user(user_id=5ed8839ed6a2488a86ef46d3f2fef578)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:00.651940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba603c1-ee0b-48df-acb0-918ce5105a1e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:00.653589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 144/289] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:56:00 2022] GET /identity/v3/users/5ed8839ed6a2488a86ef46d3f2fef578 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:00.659632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba603c1-ee0b-48df-acb0-918ce5105a1e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:00.727384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cab5c4-37ac-4aee-b795-6f8688caa613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:00.730158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cab5c4-37ac-4aee-b795-6f8688caa613 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:00.857191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba603c1-ee0b-48df-acb0-918ce5105a1e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:00.914778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 146/290] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:00.920314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cab5c4-37ac-4aee-b795-6f8688caa613 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:00.929907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614ea1-6c29-48de-8ac6-658f22094c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:00.930819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614ea1-6c29-48de-8ac6-658f22094c64 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:00.931107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614ea1-6c29-48de-8ac6-658f22094c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:00.931388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614ea1-6c29-48de-8ac6-658f22094c64 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:00.934592 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec614ea1-6c29-48de-8ac6-658f22094c64 None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:00.936051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec614ea1-6c29-48de-8ac6-658f22094c64 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:00.938832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 145/291] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:00 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:00.944985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614ea1-6c29-48de-8ac6-658f22094c64 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:00.978871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:01.024860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:01.092644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614ea1-6c29-48de-8ac6-658f22094c64 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:01.123308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cab5c4-37ac-4aee-b795-6f8688caa613 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:01.163312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c72ef-49d4-4783-b46b-f1c456b86cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:01.164580 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c72ef-49d4-4783-b46b-f1c456b86cff None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:01.165063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c72ef-49d4-4783-b46b-f1c456b86cff None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:01.165535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c72ef-49d4-4783-b46b-f1c456b86cff None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/users/5ed8839ed6a2488a86ef46d3f2fef578/roles/84808704b93544b6b353735cb3c5825f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:01.169190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c72ef-49d4-4783-b46b-f1c456b86cff None admin] RBAC: Authorizing `identity:create_grant(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f, user_id=5ed8839ed6a2488a86ef46d3f2fef578, role_id=84808704b93544b6b353735cb3c5825f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:01.170942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c72ef-49d4-4783-b46b-f1c456b86cff None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:01.191516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5cc3-d72c-45f2-af6d-da97c14f18aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:01.193031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5cc3-d72c-45f2-af6d-da97c14f18aa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:01.193512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5cc3-d72c-45f2-af6d-da97c14f18aa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:01.194090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f5cc3-d72c-45f2-af6d-da97c14f18aa None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:01.196042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f5cc3-d72c-45f2-af6d-da97c14f18aa None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:01.197998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f5cc3-d72c-45f2-af6d-da97c14f18aa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:01.203743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 147/292] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:00 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:01.207043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5cc3-d72c-45f2-af6d-da97c14f18aa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:01.281986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 146/293] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:56:00 2022] PUT /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/users/5ed8839ed6a2488a86ef46d3f2fef578/roles/84808704b93544b6b353735cb3c5825f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:56:01.342765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f5cc3-d72c-45f2-af6d-da97c14f18aa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:01.350057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:01.393747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399acbe-a709-45bc-8ec1-a5d23b1be5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:01.394730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399acbe-a709-45bc-8ec1-a5d23b1be5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:01.395195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399acbe-a709-45bc-8ec1-a5d23b1be5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:01.395672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399acbe-a709-45bc-8ec1-a5d23b1be5f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:01.396693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399acbe-a709-45bc-8ec1-a5d23b1be5f4 None admin] RBAC: Adding query filter params (role.id=ec78785738f441ec9be64e122e252506, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f, user.id=84ec3c7a37724eabb8d5ddb9fb7681bc) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:01.397226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399acbe-a709-45bc-8ec1-a5d23b1be5f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:01.398895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399acbe-a709-45bc-8ec1-a5d23b1be5f4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:01.405495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 148/294] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:01 2022] GET /identity/v3/role_assignments?user.id=84ec3c7a37724eabb8d5ddb9fb7681bc&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=ec78785738f441ec9be64e122e252506 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:02.387292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93c5f-c418-4de2-922a-55d4d1d8e8b5 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.388328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93c5f-c418-4de2-922a-55d4d1d8e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.388813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f93c5f-c418-4de2-922a-55d4d1d8e8b5 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.390408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 147/295] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:02.396185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147224-5d61-404b-829a-025f66c2efaa None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.397738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147224-5d61-404b-829a-025f66c2efaa None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.398266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55147224-5d61-404b-829a-025f66c2efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.416717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-55147224-5d61-404b-829a-025f66c2efaa None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:02.418647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-55147224-5d61-404b-829a-025f66c2efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:02.442223 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03141530-f994-49bb-995c-af5e298597c9 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.442851 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03141530-f994-49bb-995c-af5e298597c9 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.443600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03141530-f994-49bb-995c-af5e298597c9 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.446207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 148/296] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:56:02.451841 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da6cc1-693a-47b0-b81c-fa193d65d0c3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.452378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da6cc1-693a-47b0-b81c-fa193d65d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.452858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da6cc1-693a-47b0-b81c-fa193d65d0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.470663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-57da6cc1-693a-47b0-b81c-fa193d65d0c3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:02.472141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-57da6cc1-693a-47b0-b81c-fa193d65d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:02.503988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 149/297] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:02.528338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55147224-5d61-404b-829a-025f66c2efaa None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:02.544449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 149/298] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:02.568267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da6cc1-693a-47b0-b81c-fa193d65d0c3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:02.620271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:02.627068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:02.636876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55147224-5d61-404b-829a-025f66c2efaa None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:02.672650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f505-5dc8-4d6a-bdd7-26f6e080db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:02.672854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da6cc1-693a-47b0-b81c-fa193d65d0c3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:02.673824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f505-5dc8-4d6a-bdd7-26f6e080db48 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.674947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f505-5dc8-4d6a-bdd7-26f6e080db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.675877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f505-5dc8-4d6a-bdd7-26f6e080db48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.677323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f505-5dc8-4d6a-bdd7-26f6e080db48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:02.679634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f505-5dc8-4d6a-bdd7-26f6e080db48 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:02.686333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 150/299] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:02.687337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f505-5dc8-4d6a-bdd7-26f6e080db48 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:02.711794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c03955-6d52-46d0-92ea-49df4c5a6dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:02.721475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03955-6d52-46d0-92ea-49df4c5a6dff None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.721475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03955-6d52-46d0-92ea-49df4c5a6dff None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.721475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03955-6d52-46d0-92ea-49df4c5a6dff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.724274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c03955-6d52-46d0-92ea-49df4c5a6dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-f2c03955-6d52-46d0-92ea-49df4c5a6dff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:02.737761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:02.738953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:02.739733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:02.745865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 150/300] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:02.747572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f125-dc29-4001-8c71-1d5312deed23 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.748024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f125-dc29-4001-8c71-1d5312deed23 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.748690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3f125-dc29-4001-8c71-1d5312deed23 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.750633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 151/301] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:56:02.751820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3f125-dc29-4001-8c71-1d5312deed23 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:02.799940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f505-5dc8-4d6a-bdd7-26f6e080db48 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:02.836717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899cb9f-db92-4e8e-81e6-8cfb52a14ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:02.837382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899cb9f-db92-4e8e-81e6-8cfb52a14ff6 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.837664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899cb9f-db92-4e8e-81e6-8cfb52a14ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.837943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899cb9f-db92-4e8e-81e6-8cfb52a14ff6 None admin] PATH_INFO: `/v3/groups` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.838652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899cb9f-db92-4e8e-81e6-8cfb52a14ff6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:02.840092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899cb9f-db92-4e8e-81e6-8cfb52a14ff6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:02.863301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3f125-dc29-4001-8c71-1d5312deed23 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:02.874078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:02.891517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 151/302] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 30 11:56:02 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:56:02.892953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c97e34-92e4-4fdf-8d5d-4d55937d4c1d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.893249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c97e34-92e4-4fdf-8d5d-4d55937d4c1d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.893532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c97e34-92e4-4fdf-8d5d-4d55937d4c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.908016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:02.909512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:02.910081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:02.910583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:02.911593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:02.912128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:02.913469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-30c97e34-92e4-4fdf-8d5d-4d55937d4c1d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:02.914286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:02.914975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-30c97e34-92e4-4fdf-8d5d-4d55937d4c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:02.927215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 152/303] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:02.933523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:02.937600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:03.006103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 152/304] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:03.024857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c97e34-92e4-4fdf-8d5d-4d55937d4c1d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:03.043793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d40ca-09c2-4daa-9c56-4bca47a6c8a3 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:03.081610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3723c-6080-452c-bfc3-4280ec168638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:03.082646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3723c-6080-452c-bfc3-4280ec168638 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:03.083007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3723c-6080-452c-bfc3-4280ec168638 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:03.083413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3723c-6080-452c-bfc3-4280ec168638 None admin] PATH_INFO: `/v3/users/3ada641875424a12b0f95a539d0bf56a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:03.099062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3723c-6080-452c-bfc3-4280ec168638 None admin] RBAC: Authorizing `identity:get_user(user_id=3ada641875424a12b0f95a539d0bf56a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:03.101226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3723c-6080-452c-bfc3-4280ec168638 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:03.103068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 153/305] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:56:02 2022] GET /identity/v3/users/3ada641875424a12b0f95a539d0bf56a => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:03.108760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3723c-6080-452c-bfc3-4280ec168638 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:03.143839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:03.144209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c97e34-92e4-4fdf-8d5d-4d55937d4c1d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:03.191678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68705b12-f00a-4500-be9d-3d19b9329b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:03.192993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68705b12-f00a-4500-be9d-3d19b9329b02 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:03.193578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68705b12-f00a-4500-be9d-3d19b9329b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:03.193860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68705b12-f00a-4500-be9d-3d19b9329b02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:03.205729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68705b12-f00a-4500-be9d-3d19b9329b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-68705b12-f00a-4500-be9d-3d19b9329b02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:03.214265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:03.215200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:03.216440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 153/306] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:03.221380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68705b12-f00a-4500-be9d-3d19b9329b02 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:03.228270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3723c-6080-452c-bfc3-4280ec168638 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:03.237841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:03.275279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:03.276118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:03.276650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:03.277076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:03.278482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] RBAC: Adding query filter params (role.id=84808704b93544b6b353735cb3c5825f, user.id=3ada641875424a12b0f95a539d0bf56a, scope.system=all) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:03.278923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:03.280911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:03.288886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 154/307] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 30 11:56:03 2022] GET /identity/v3/role_assignments?user.id=3ada641875424a12b0f95a539d0bf56a&scope.system=all&role.id=84808704b93544b6b353735cb3c5825f => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:03.340947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68705b12-f00a-4500-be9d-3d19b9329b02 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:03.382267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:03.383337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:03.383821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:03.384294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:03.385301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:03.385818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:03.387611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:03.398684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 154/308] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:03.405229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:03.519435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:03.522866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943b01d-d297-49f9-b28f-91ce18cb8bb2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:03.558436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21c5c-7283-4b57-b368-4a46decec299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:03.559367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21c5c-7283-4b57-b368-4a46decec299 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:03.559656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21c5c-7283-4b57-b368-4a46decec299 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:03.559933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21c5c-7283-4b57-b368-4a46decec299 None admin] PATH_INFO: `/v3/users/61fdb3b1f08241df9e270bda4403014a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:03.561129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba21c5c-7283-4b57-b368-4a46decec299 None admin] RBAC: Authorizing `identity:get_user(user_id=61fdb3b1f08241df9e270bda4403014a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:03.562709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba21c5c-7283-4b57-b368-4a46decec299 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:03.564339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 155/309] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:56:03 2022] GET /identity/v3/users/61fdb3b1f08241df9e270bda4403014a => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:03.570026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:03.644105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:03.674335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d1b6-d86e-4379-9479-f1d46f7f1ad5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:03.710364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5319da-3117-47a3-86a2-b93763c98f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:03.711235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5319da-3117-47a3-86a2-b93763c98f89 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:03.711517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5319da-3117-47a3-86a2-b93763c98f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:03.711792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5319da-3117-47a3-86a2-b93763c98f89 None admin] PATH_INFO: `/v3/system/users/61fdb3b1f08241df9e270bda4403014a/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:03.713273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5319da-3117-47a3-86a2-b93763c98f89 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=61fdb3b1f08241df9e270bda4403014a, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:03.714707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5319da-3117-47a3-86a2-b93763c98f89 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:03.802943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 155/310] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 30 11:56:03 2022] PUT /identity/v3/system/users/61fdb3b1f08241df9e270bda4403014a/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:03.836225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a74d-ddc0-44a8-bd3f-a48695213421 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:03.836545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a74d-ddc0-44a8-bd3f-a48695213421 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:03.836888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590a74d-ddc0-44a8-bd3f-a48695213421 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:03.838390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 156/311] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:03.844601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0cd4f-46e1-4e88-b773-e7199774d8ab None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:03.844903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0cd4f-46e1-4e88-b773-e7199774d8ab None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:03.845178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0cd4f-46e1-4e88-b773-e7199774d8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:03.864442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-05f0cd4f-46e1-4e88-b773-e7199774d8ab None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:03.865690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-05f0cd4f-46e1-4e88-b773-e7199774d8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:03.942085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 156/312] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:03.966888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590a74d-ddc0-44a8-bd3f-a48695213421 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:04.075654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590a74d-ddc0-44a8-bd3f-a48695213421 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:04.111111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64cc89-d448-48b7-8f7d-fb759fbaf208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:04.111965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64cc89-d448-48b7-8f7d-fb759fbaf208 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:04.112255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64cc89-d448-48b7-8f7d-fb759fbaf208 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:04.112531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64cc89-d448-48b7-8f7d-fb759fbaf208 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:04.123906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64cc89-d448-48b7-8f7d-fb759fbaf208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-7d64cc89-d448-48b7-8f7d-fb759fbaf208 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:04.132638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:04.135006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:04.135938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 157/313] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:04.140665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0cd4f-46e1-4e88-b773-e7199774d8ab None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:04.208655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:04.243640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0cd4f-46e1-4e88-b773-e7199774d8ab None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:04.278548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:04.279421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:04.279775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:04.280539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:04.281301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:04.281613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:04.283058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:04.291861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 157/314] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:04.297490 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64cc89-d448-48b7-8f7d-fb759fbaf208 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:04.325786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:04.406475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64cc89-d448-48b7-8f7d-fb759fbaf208 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:04.441029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaac63-3b59-4606-97c2-5803b70425b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:04.441905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaac63-3b59-4606-97c2-5803b70425b1 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:04.442214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaac63-3b59-4606-97c2-5803b70425b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:04.442494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaac63-3b59-4606-97c2-5803b70425b1 None admin] PATH_INFO: `/v3/users/5ed8839ed6a2488a86ef46d3f2fef578` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:04.443683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaac63-3b59-4606-97c2-5803b70425b1 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed8839ed6a2488a86ef46d3f2fef578)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:04.445697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaac63-3b59-4606-97c2-5803b70425b1 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:04.447602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 158/315] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:56:04 2022] GET /identity/v3/users/5ed8839ed6a2488a86ef46d3f2fef578 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:04.453071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:04.557016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefc50b-f261-4b08-822c-1542ee211689 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:04.585083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:04.593289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442f609-6cd3-4c5d-afb9-2c688779a007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:04.597342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442f609-6cd3-4c5d-afb9-2c688779a007 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:04.597342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442f609-6cd3-4c5d-afb9-2c688779a007 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:04.597342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442f609-6cd3-4c5d-afb9-2c688779a007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:04.665479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442f609-6cd3-4c5d-afb9-2c688779a007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:04.667328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442f609-6cd3-4c5d-afb9-2c688779a007 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:04.768969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 158/316] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:04.774283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaac63-3b59-4606-97c2-5803b70425b1 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:04.868428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:04.884166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaac63-3b59-4606-97c2-5803b70425b1 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:04.919325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33a69-e25f-4289-a854-3ee7e9539b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:04.920197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33a69-e25f-4289-a854-3ee7e9539b58 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:04.920485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33a69-e25f-4289-a854-3ee7e9539b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:04.920767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33a69-e25f-4289-a854-3ee7e9539b58 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:04.921985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33a69-e25f-4289-a854-3ee7e9539b58 None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:04.923461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33a69-e25f-4289-a854-3ee7e9539b58 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:04.925475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 159/317] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:04 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:04.932304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442f609-6cd3-4c5d-afb9-2c688779a007 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:04.962840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:05.042314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442f609-6cd3-4c5d-afb9-2c688779a007 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:05.077463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65767c1d-ec2f-43d5-9fcd-6526b5dcac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:05.078489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767c1d-ec2f-43d5-9fcd-6526b5dcac40 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:05.078975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767c1d-ec2f-43d5-9fcd-6526b5dcac40 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:05.079470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767c1d-ec2f-43d5-9fcd-6526b5dcac40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:05.080495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65767c1d-ec2f-43d5-9fcd-6526b5dcac40 None admin] RBAC: Adding query filter params (role.id=84808704b93544b6b353735cb3c5825f, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f, user.id=5ed8839ed6a2488a86ef46d3f2fef578) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:05.081024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65767c1d-ec2f-43d5-9fcd-6526b5dcac40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:05.082706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65767c1d-ec2f-43d5-9fcd-6526b5dcac40 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:05.090008 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 159/318] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:04 2022] GET /identity/v3/role_assignments?user.id=5ed8839ed6a2488a86ef46d3f2fef578&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=84808704b93544b6b353735cb3c5825f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:05.310096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1ff0-4d8b-4492-979c-03f807d59d04 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:05.310465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1ff0-4d8b-4492-979c-03f807d59d04 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:05.310669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1ff0-4d8b-4492-979c-03f807d59d04 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:05.312185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 160/319] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:05.317808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa824eca-034f-4cb3-ac3d-c39e80176f25 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:05.318363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa824eca-034f-4cb3-ac3d-c39e80176f25 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:05.319373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa824eca-034f-4cb3-ac3d-c39e80176f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:05.337719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fa824eca-034f-4cb3-ac3d-c39e80176f25 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:05.339244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fa824eca-034f-4cb3-ac3d-c39e80176f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:05.413261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 160/320] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:05.435462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1ff0-4d8b-4492-979c-03f807d59d04 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:05.537612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1ff0-4d8b-4492-979c-03f807d59d04 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:05.571367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc37e2-b998-4fb5-9382-be0bfbbbaaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:05.572348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc37e2-b998-4fb5-9382-be0bfbbbaaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:05.572627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc37e2-b998-4fb5-9382-be0bfbbbaaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:05.572898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc37e2-b998-4fb5-9382-be0bfbbbaaf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:05.574097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc37e2-b998-4fb5-9382-be0bfbbbaaf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:05.575543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc37e2-b998-4fb5-9382-be0bfbbbaaf0 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:05.577365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 161/321] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:05.582764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa824eca-034f-4cb3-ac3d-c39e80176f25 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:05.607036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:05.682755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa824eca-034f-4cb3-ac3d-c39e80176f25 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:05.691095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d3dcd-3996-4cdc-9412-2d6819158e42 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:05.691389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d3dcd-3996-4cdc-9412-2d6819158e42 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:05.691665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d3dcd-3996-4cdc-9412-2d6819158e42 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:05.693163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 162/322] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:05.698668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e48e3-55dc-430c-8ed4-ae329ba22379 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:05.698958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e48e3-55dc-430c-8ed4-ae329ba22379 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:05.699239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e48e3-55dc-430c-8ed4-ae329ba22379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:05.715428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ab7e48e3-55dc-430c-8ed4-ae329ba22379 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:05.716625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ab7e48e3-55dc-430c-8ed4-ae329ba22379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:05.718904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78550aee-2cb2-4e51-b2f5-f36c3bf08017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:05.719578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550aee-2cb2-4e51-b2f5-f36c3bf08017 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:05.719861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550aee-2cb2-4e51-b2f5-f36c3bf08017 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:05.720140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78550aee-2cb2-4e51-b2f5-f36c3bf08017 None admin] PATH_INFO: `/v3/groups` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:05.720840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78550aee-2cb2-4e51-b2f5-f36c3bf08017 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:05.722326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78550aee-2cb2-4e51-b2f5-f36c3bf08017 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:05.740403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:05.786317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 163/323] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:05.808798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e48e3-55dc-430c-8ed4-ae329ba22379 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:05.817316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 161/324] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 30 11:56:05 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:56:05.924610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e48e3-55dc-430c-8ed4-ae329ba22379 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:05.961878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ee7b9-3576-48aa-a89d-17e97bea6855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:05.962732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee7b9-3576-48aa-a89d-17e97bea6855 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:05.963020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee7b9-3576-48aa-a89d-17e97bea6855 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:05.963299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee7b9-3576-48aa-a89d-17e97bea6855 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:05.975592 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ee7b9-3576-48aa-a89d-17e97bea6855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-579ee7b9-3576-48aa-a89d-17e97bea6855 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:05.983730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:05.984646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:05.985442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:05.992037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 164/325] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:05.992193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78550aee-2cb2-4e51-b2f5-f36c3bf08017 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:06.078826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:06.098186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78550aee-2cb2-4e51-b2f5-f36c3bf08017 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:06.137159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fbec4-16b9-417f-b053-a91b3ccfe1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:06.137840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fbec4-16b9-417f-b053-a91b3ccfe1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:06.138206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fbec4-16b9-417f-b053-a91b3ccfe1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:06.138486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fbec4-16b9-417f-b053-a91b3ccfe1c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:06.139247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fbec4-16b9-417f-b053-a91b3ccfe1c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:06.139561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fbec4-16b9-417f-b053-a91b3ccfe1c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:06.140947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fbec4-16b9-417f-b053-a91b3ccfe1c5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:06.152206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 162/326] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:06.158042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ee7b9-3576-48aa-a89d-17e97bea6855 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:06.180438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:06.189602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d34ca-c2af-4cb7-b80b-ae589ba12859 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:06.189895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d34ca-c2af-4cb7-b80b-ae589ba12859 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:06.190230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d34ca-c2af-4cb7-b80b-ae589ba12859 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:06.191771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 163/327] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:06.197774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc618dd-cdf9-4d19-a367-8c7888dc06e3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:06.197774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc618dd-cdf9-4d19-a367-8c7888dc06e3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:06.197774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc618dd-cdf9-4d19-a367-8c7888dc06e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:06.215052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4bc618dd-cdf9-4d19-a367-8c7888dc06e3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:06.216251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4bc618dd-cdf9-4d19-a367-8c7888dc06e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:06.282226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ee7b9-3576-48aa-a89d-17e97bea6855 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:06.298818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 164/328] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:06.323762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20cdaa-1314-46b3-86db-69b88ccd50c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:06.324653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20cdaa-1314-46b3-86db-69b88ccd50c8 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:06.324941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20cdaa-1314-46b3-86db-69b88ccd50c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:06.325228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20cdaa-1314-46b3-86db-69b88ccd50c8 None admin] PATH_INFO: `/v3/users/3ada641875424a12b0f95a539d0bf56a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:06.326477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20cdaa-1314-46b3-86db-69b88ccd50c8 None admin] RBAC: Authorizing `identity:get_user(user_id=3ada641875424a12b0f95a539d0bf56a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:06.328042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20cdaa-1314-46b3-86db-69b88ccd50c8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:06.328287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc618dd-cdf9-4d19-a367-8c7888dc06e3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:06.329709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 165/329] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:56:06 2022] GET /identity/v3/users/3ada641875424a12b0f95a539d0bf56a => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:06.335581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20cdaa-1314-46b3-86db-69b88ccd50c8 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:06.426892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:06.439838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:06.456398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20cdaa-1314-46b3-86db-69b88ccd50c8 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:06.462869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc618dd-cdf9-4d19-a367-8c7888dc06e3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:06.493641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b8bce-7447-4212-91e1-d7f99303d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:06.494561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b8bce-7447-4212-91e1-d7f99303d49d None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:06.494858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b8bce-7447-4212-91e1-d7f99303d49d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:06.495145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b8bce-7447-4212-91e1-d7f99303d49d None admin] PATH_INFO: `/v3/system/users/3ada641875424a12b0f95a539d0bf56a/roles/84808704b93544b6b353735cb3c5825f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:06.496750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b8bce-7447-4212-91e1-d7f99303d49d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3ada641875424a12b0f95a539d0bf56a, role_id=84808704b93544b6b353735cb3c5825f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:06.498130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b8bce-7447-4212-91e1-d7f99303d49d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:06.511071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8d66-af58-4520-9c1a-de41fcfd2a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:06.512153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8d66-af58-4520-9c1a-de41fcfd2a5c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:06.512532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8d66-af58-4520-9c1a-de41fcfd2a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:06.512817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8d66-af58-4520-9c1a-de41fcfd2a5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:06.524647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d8d66-af58-4520-9c1a-de41fcfd2a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ed2d8d66-af58-4520-9c1a-de41fcfd2a5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:06.532666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:06.533568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:06.534466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 165/330] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:06.542162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8d66-af58-4520-9c1a-de41fcfd2a5c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:06.578463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 166/331] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 30 11:56:06 2022] PUT /identity/v3/system/users/3ada641875424a12b0f95a539d0bf56a/roles/84808704b93544b6b353735cb3c5825f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:06.656114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d8d66-af58-4520-9c1a-de41fcfd2a5c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:06.692961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:06.693613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:06.694013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:06.694337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:06.695103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:06.695411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:06.697073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:06.698800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:06.707576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 166/332] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:06.713684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b8bce-7447-4212-91e1-d7f99303d49d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:06.831698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b8bce-7447-4212-91e1-d7f99303d49d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:06.880663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134d482-22d3-43ec-9694-8bc5c2cfcaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:06.882157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d482-22d3-43ec-9694-8bc5c2cfcaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:06.882445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d482-22d3-43ec-9694-8bc5c2cfcaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:06.882722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134d482-22d3-43ec-9694-8bc5c2cfcaa1 None admin] PATH_INFO: `/v3/users/61fdb3b1f08241df9e270bda4403014a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:06.887013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134d482-22d3-43ec-9694-8bc5c2cfcaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=61fdb3b1f08241df9e270bda4403014a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:06.888215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134d482-22d3-43ec-9694-8bc5c2cfcaa1 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:06.890157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 167/333] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:56:06 2022] GET /identity/v3/users/61fdb3b1f08241df9e270bda4403014a => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:06.895743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:07.026581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71777-bcb4-4a0b-a0c9-b76facb81d25 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:07.066492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92089f4-de83-4bd9-9bd9-dd29e9921105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:07.067159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92089f4-de83-4bd9-9bd9-dd29e9921105 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:07.067447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92089f4-de83-4bd9-9bd9-dd29e9921105 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:07.067728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92089f4-de83-4bd9-9bd9-dd29e9921105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:07.068565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92089f4-de83-4bd9-9bd9-dd29e9921105 None admin] RBAC: Adding query filter params (role.id=ec78785738f441ec9be64e122e252506, user.id=61fdb3b1f08241df9e270bda4403014a, scope.system=all) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:07.069446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92089f4-de83-4bd9-9bd9-dd29e9921105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:07.070955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92089f4-de83-4bd9-9bd9-dd29e9921105 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:07.088883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 167/334] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 30 11:56:06 2022] GET /identity/v3/role_assignments?user.id=61fdb3b1f08241df9e270bda4403014a&scope.system=all&role.id=ec78785738f441ec9be64e122e252506 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:08.994979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419d6c-62d6-4d30-bc0a-9d214b6539b4 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:08.995553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419d6c-62d6-4d30-bc0a-9d214b6539b4 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:08.995553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419d6c-62d6-4d30-bc0a-9d214b6539b4 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:08.997219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 168/335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:09.002716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a58330-ba69-4133-9c2d-c6a0d126dda4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:09.003596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a58330-ba69-4133-9c2d-c6a0d126dda4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:09.004099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a58330-ba69-4133-9c2d-c6a0d126dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:09.024736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a4a58330-ba69-4133-9c2d-c6a0d126dda4 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:09.026317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a4a58330-ba69-4133-9c2d-c6a0d126dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:09.092359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:09.112270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 168/336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:09.151498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419d6c-62d6-4d30-bc0a-9d214b6539b4 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:09.175652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:09.249885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54898429-c656-4aef-91bb-dfd357dc8115 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:09.250583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54898429-c656-4aef-91bb-dfd357dc8115 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:09.251065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54898429-c656-4aef-91bb-dfd357dc8115 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:09.253057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 169/337] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:09.260135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4c87-3122-4157-b141-0ca6b6fa844a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:09.260683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4c87-3122-4157-b141-0ca6b6fa844a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:09.261256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4c87-3122-4157-b141-0ca6b6fa844a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:09.294445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ba6b4c87-3122-4157-b141-0ca6b6fa844a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:09.295646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ba6b4c87-3122-4157-b141-0ca6b6fa844a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:09.299636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419d6c-62d6-4d30-bc0a-9d214b6539b4 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:09.359932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659977-e934-47bf-90fc-5eaf12ce65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:09.360741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659977-e934-47bf-90fc-5eaf12ce65c4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:09.361030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659977-e934-47bf-90fc-5eaf12ce65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:09.361313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659977-e934-47bf-90fc-5eaf12ce65c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:09.387618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4659977-e934-47bf-90fc-5eaf12ce65c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-a4659977-e934-47bf-90fc-5eaf12ce65c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:09.395474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:09.396403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:09.397769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 169/338] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:09.403343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659977-e934-47bf-90fc-5eaf12ce65c4 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:09.424153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 170/339] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:09.457738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b4c87-3122-4157-b141-0ca6b6fa844a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:09.552784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:09.579464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659977-e934-47bf-90fc-5eaf12ce65c4 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:09.632119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:09.632808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:09.633095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:09.633378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:09.634159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:09.634468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:09.635859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:09.668278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 170/340] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:09.674553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:09.676888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b4c87-3122-4157-b141-0ca6b6fa844a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:09.702322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:09.727431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1fc10-e15d-493c-96cb-f8420917ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:09.733846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1fc10-e15d-493c-96cb-f8420917ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:09.736500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1fc10-e15d-493c-96cb-f8420917ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:09.736806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1fc10-e15d-493c-96cb-f8420917ffb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:09.756655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1fc10-e15d-493c-96cb-f8420917ffb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-62a1fc10-e15d-493c-96cb-f8420917ffb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:09.764964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:09.765823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:09.766634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:09.767224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 171/341] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:09.775489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1fc10-e15d-493c-96cb-f8420917ffb7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:09.842502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf32378-5395-47f7-9801-b80a5442c3e4 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:09.889584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a81887-739a-4a24-a8b9-23e111ae3a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:09.890540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81887-739a-4a24-a8b9-23e111ae3a91 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:09.890962 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81887-739a-4a24-a8b9-23e111ae3a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:09.891376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a81887-739a-4a24-a8b9-23e111ae3a91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:09.903272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:09.956586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1fc10-e15d-493c-96cb-f8420917ffb7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:10.004887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce212b-a4fa-482f-85d4-8275a32b48a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:10.005564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce212b-a4fa-482f-85d4-8275a32b48a3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.006580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce212b-a4fa-482f-85d4-8275a32b48a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.007037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce212b-a4fa-482f-85d4-8275a32b48a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.008312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce212b-a4fa-482f-85d4-8275a32b48a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:10.008779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce212b-a4fa-482f-85d4-8275a32b48a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:10.010360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce212b-a4fa-482f-85d4-8275a32b48a3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:10.022452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 172/342] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:10.024655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c23a6-9b18-454c-93f4-80043985ad27 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.025113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c23a6-9b18-454c-93f4-80043985ad27 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.025540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c23a6-9b18-454c-93f4-80043985ad27 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.027598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 173/343] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:10.028130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a81887-739a-4a24-a8b9-23e111ae3a91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:10.029031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c23a6-9b18-454c-93f4-80043985ad27 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:10.029622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a81887-739a-4a24-a8b9-23e111ae3a91 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:10.078350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:10.173260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 171/344] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 30 11:56:10.174539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187eb1-e556-4329-8781-75d8bf07e211 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.174831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187eb1-e556-4329-8781-75d8bf07e211 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.175111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187eb1-e556-4329-8781-75d8bf07e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.193312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-bd187eb1-e556-4329-8781-75d8bf07e211 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:10.195110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bd187eb1-e556-4329-8781-75d8bf07e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:10.200281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c23a6-9b18-454c-93f4-80043985ad27 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:10.249122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbad1c2-715f-46d3-a199-d379a7b8e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:10.250081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbad1c2-715f-46d3-a199-d379a7b8e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.250528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbad1c2-715f-46d3-a199-d379a7b8e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.251353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbad1c2-715f-46d3-a199-d379a7b8e7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.286406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:10.346840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 172/345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:10.347941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187eb1-e556-4329-8781-75d8bf07e211 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:10.364197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbad1c2-715f-46d3-a199-d379a7b8e7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:10.366511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbad1c2-715f-46d3-a199-d379a7b8e7b1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:10.429443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:10.475820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187eb1-e556-4329-8781-75d8bf07e211 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:10.520449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440746e7-75cd-4ebb-a6e4-190b47be3234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:10.521743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440746e7-75cd-4ebb-a6e4-190b47be3234 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.522199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440746e7-75cd-4ebb-a6e4-190b47be3234 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.522624 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440746e7-75cd-4ebb-a6e4-190b47be3234 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.524179 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440746e7-75cd-4ebb-a6e4-190b47be3234 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:10.525782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440746e7-75cd-4ebb-a6e4-190b47be3234 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:10.527841 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 173/346] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:10 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:10.529927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c2c5-d58a-4613-8fa8-5836c4052c4f None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.530403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c2c5-d58a-4613-8fa8-5836c4052c4f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.530827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c2c5-d58a-4613-8fa8-5836c4052c4f None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.532297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 174/347] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:10.533259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490c2c5-d58a-4613-8fa8-5836c4052c4f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:10.543554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 174/348] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:10.544959 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbad1c2-715f-46d3-a199-d379a7b8e7b1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:10.589576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:10.674903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490c2c5-d58a-4613-8fa8-5836c4052c4f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:10.690563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbad1c2-715f-46d3-a199-d379a7b8e7b1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:10.712290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03134e-4714-47d9-8de2-62d9e2749567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:10.713279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03134e-4714-47d9-8de2-62d9e2749567 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.713571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03134e-4714-47d9-8de2-62d9e2749567 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.714237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03134e-4714-47d9-8de2-62d9e2749567 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.735468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03134e-4714-47d9-8de2-62d9e2749567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-3a03134e-4714-47d9-8de2-62d9e2749567 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:10.744938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:10.746044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:10.746894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 175/349] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:56:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:10.747565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c242e3-78eb-4556-b7aa-9820eb2de16a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.747833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c242e3-78eb-4556-b7aa-9820eb2de16a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.748118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c242e3-78eb-4556-b7aa-9820eb2de16a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.749206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dad7ff-3e3f-45db-9b65-707f36e15297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:10.749635 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 176/350] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:10.750461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad7ff-3e3f-45db-9b65-707f36e15297 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.750926 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad7ff-3e3f-45db-9b65-707f36e15297 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.751329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad7ff-3e3f-45db-9b65-707f36e15297 None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.756379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be18b-d83b-43e6-89fc-ed4480f9034b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.756554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be18b-d83b-43e6-89fc-ed4480f9034b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.758492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be18b-d83b-43e6-89fc-ed4480f9034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.759965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dad7ff-3e3f-45db-9b65-707f36e15297 None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:10.762948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:10.764407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dad7ff-3e3f-45db-9b65-707f36e15297 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:10.766600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 175/351] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:10 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:10.767603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dad7ff-3e3f-45db-9b65-707f36e15297 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:10.788317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-663be18b-d83b-43e6-89fc-ed4480f9034b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:10.790083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-663be18b-d83b-43e6-89fc-ed4480f9034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:10.875781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 177/352] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:10.876637 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663be18b-d83b-43e6-89fc-ed4480f9034b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:10.916223 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dad7ff-3e3f-45db-9b65-707f36e15297 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:10.916813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:10.968261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f29cb-05c4-432d-94f5-a9d63b1109fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:10.969473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f29cb-05c4-432d-94f5-a9d63b1109fd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.969473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f29cb-05c4-432d-94f5-a9d63b1109fd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.969670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f29cb-05c4-432d-94f5-a9d63b1109fd None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:10.973435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f29cb-05c4-432d-94f5-a9d63b1109fd None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:10.973435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f29cb-05c4-432d-94f5-a9d63b1109fd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:10.975745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 176/353] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:10 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:10.980391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27844a6-3828-401d-9ae9-89004f90e7f7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:10.980391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27844a6-3828-401d-9ae9-89004f90e7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:10.980391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27844a6-3828-401d-9ae9-89004f90e7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.002193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d27844a6-3828-401d-9ae9-89004f90e7f7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:11.003405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d27844a6-3828-401d-9ae9-89004f90e7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:11.012526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663be18b-d83b-43e6-89fc-ed4480f9034b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:11.053716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:11.054745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.055180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.056734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.056734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:11.056734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:11.059189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:11.068177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 178/354] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:11.069120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:11.082545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:11.089534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 177/355] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:11.090417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27844a6-3828-401d-9ae9-89004f90e7f7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:11.175629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:11.187944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3a40-fac1-456b-bd2a-f261540421df None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:11.210459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27844a6-3828-401d-9ae9-89004f90e7f7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:11.232068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a337660-78ff-4962-98e2-4988cbaac612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:11.232385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a337660-78ff-4962-98e2-4988cbaac612 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.232577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a337660-78ff-4962-98e2-4988cbaac612 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.232859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a337660-78ff-4962-98e2-4988cbaac612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.235478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a337660-78ff-4962-98e2-4988cbaac612 None admin] RBAC: Adding query filter params (group.id=f674afe768ba475c9b7b8cd50adda337, role.id=ec78785738f441ec9be64e122e252506, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:11.235478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a337660-78ff-4962-98e2-4988cbaac612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:11.235478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a337660-78ff-4962-98e2-4988cbaac612 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:11.243719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 179/356] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/role_assignments?group.id=f674afe768ba475c9b7b8cd50adda337&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=ec78785738f441ec9be64e122e252506 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:11.245084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16198686-12aa-4cd0-844f-f220df1b0fe0 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.246333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16198686-12aa-4cd0-844f-f220df1b0fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.246815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16198686-12aa-4cd0-844f-f220df1b0fe0 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.248353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 180/357] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:11.249117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16198686-12aa-4cd0-844f-f220df1b0fe0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:11.250759 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2bee2-3fb2-4eff-8b71-ac08a1381339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:11.251603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bee2-3fb2-4eff-8b71-ac08a1381339 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.251887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bee2-3fb2-4eff-8b71-ac08a1381339 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.252163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bee2-3fb2-4eff-8b71-ac08a1381339 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.266731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2bee2-3fb2-4eff-8b71-ac08a1381339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-dff2bee2-3fb2-4eff-8b71-ac08a1381339 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:11.275225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:11.276219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 178/358] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:11.277364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2bee2-3fb2-4eff-8b71-ac08a1381339 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:11.360118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:11.404960 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16198686-12aa-4cd0-844f-f220df1b0fe0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:11.424055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2bee2-3fb2-4eff-8b71-ac08a1381339 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:11.452204 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f86fff-0445-45f9-a9b1-86ce04346ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:11.453531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86fff-0445-45f9-a9b1-86ce04346ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.453818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86fff-0445-45f9-a9b1-86ce04346ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.454129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86fff-0445-45f9-a9b1-86ce04346ab0 None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.455336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86fff-0445-45f9-a9b1-86ce04346ab0 None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:11.456878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86fff-0445-45f9-a9b1-86ce04346ab0 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:11.458620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 181/359] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:11.459428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f86fff-0445-45f9-a9b1-86ce04346ab0 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:11.479652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d5080-d1f8-4dbc-aea4-32bfbf53c9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:11.479652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d5080-d1f8-4dbc-aea4-32bfbf53c9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.479652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d5080-d1f8-4dbc-aea4-32bfbf53c9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.479652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d5080-d1f8-4dbc-aea4-32bfbf53c9c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.489031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:11.568236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d5080-d1f8-4dbc-aea4-32bfbf53c9c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:11.570254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d5080-d1f8-4dbc-aea4-32bfbf53c9c4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:11.597106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f86fff-0445-45f9-a9b1-86ce04346ab0 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:11.644079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4ee9c-1fd7-4160-84d0-12e62eef28e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:11.645010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ee9c-1fd7-4160-84d0-12e62eef28e3 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.645263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ee9c-1fd7-4160-84d0-12e62eef28e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.645539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ee9c-1fd7-4160-84d0-12e62eef28e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.652214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:11.658496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4ee9c-1fd7-4160-84d0-12e62eef28e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-beb4ee9c-1fd7-4160-84d0-12e62eef28e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:11.667157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:11.668065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:11.668857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 182/360] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:11.669522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeec7c-c698-48ca-881c-92f43212d5a8 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.670622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeec7c-c698-48ca-881c-92f43212d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.670622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeec7c-c698-48ca-881c-92f43212d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.690297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ecaeec7c-c698-48ca-881c-92f43212d5a8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:11.691513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ecaeec7c-c698-48ca-881c-92f43212d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:11.719658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 179/361] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:11.720980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d5080-d1f8-4dbc-aea4-32bfbf53c9c4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:11.775123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 183/362] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:11.776128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeec7c-c698-48ca-881c-92f43212d5a8 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:11.791467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:11.844898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d5080-d1f8-4dbc-aea4-32bfbf53c9c4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:11.898293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:11.899249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.899543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.899826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.900585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:11.900893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:11.901443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeec7c-c698-48ca-881c-92f43212d5a8 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:11.902309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:11.913527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 180/363] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:11.918673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:11.946859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:11.951824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:11.952495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:11.952781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:11.953127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:11.954226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] RBAC: Adding query filter params (group.id=f674afe768ba475c9b7b8cd50adda337, role.id=ec78785738f441ec9be64e122e252506, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:11.960100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:11.960100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:11.962981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 184/364] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/role_assignments?group.id=f674afe768ba475c9b7b8cd50adda337&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=ec78785738f441ec9be64e122e252506 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:11.963705 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.047957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:12.050533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0991e-48a5-4c8f-8358-3fe524333983 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.077886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e0219-ba2f-4023-b196-a45db8df673c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.120397 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce362d-511e-4092-a6c2-364f89a881c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.121285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce362d-511e-4092-a6c2-364f89a881c5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.121564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce362d-511e-4092-a6c2-364f89a881c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.121833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce362d-511e-4092-a6c2-364f89a881c5 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.123126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce362d-511e-4092-a6c2-364f89a881c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:12.127519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce362d-511e-4092-a6c2-364f89a881c5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:12.127519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 185/365] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:12.127519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce362d-511e-4092-a6c2-364f89a881c5 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.131907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.132604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.132892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.133170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.133938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:12.134274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:12.135691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:12.149932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 181/366] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:12.151183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.267817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce362d-511e-4092-a6c2-364f89a881c5 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.270101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:12.300317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5584d9-c956-44fb-a7ff-5912efdecb3a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.316649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae2448-31e2-4005-a8a4-2c2682a9e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.317459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2448-31e2-4005-a8a4-2c2682a9e63f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.317748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2448-31e2-4005-a8a4-2c2682a9e63f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.318070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2448-31e2-4005-a8a4-2c2682a9e63f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.332003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae2448-31e2-4005-a8a4-2c2682a9e63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-c7ae2448-31e2-4005-a8a4-2c2682a9e63f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:12.340779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:12.341707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:12.342539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:12.344524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 186/367] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:12.349528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae2448-31e2-4005-a8a4-2c2682a9e63f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.351464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743449c2-fa9e-491d-8574-7c6e5f0831f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.352521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:12.353821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743449c2-fa9e-491d-8574-7c6e5f0831f8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.355221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743449c2-fa9e-491d-8574-7c6e5f0831f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.355733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743449c2-fa9e-491d-8574-7c6e5f0831f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.442138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743449c2-fa9e-491d-8574-7c6e5f0831f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:12.442981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743449c2-fa9e-491d-8574-7c6e5f0831f8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:12.482371 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae2448-31e2-4005-a8a4-2c2682a9e63f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.524292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6292b-7670-41a7-859c-f0f8666e83db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.525434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6292b-7670-41a7-859c-f0f8666e83db None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.526304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6292b-7670-41a7-859c-f0f8666e83db None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.526811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6292b-7670-41a7-859c-f0f8666e83db None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.528100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6292b-7670-41a7-859c-f0f8666e83db None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:12.529714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6292b-7670-41a7-859c-f0f8666e83db None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:12.531879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 187/368] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:12.532797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6292b-7670-41a7-859c-f0f8666e83db None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.547545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:12.574587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 182/369] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:12.575873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743449c2-fa9e-491d-8574-7c6e5f0831f8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.623733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:12.664337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6292b-7670-41a7-859c-f0f8666e83db None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.708124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743449c2-fa9e-491d-8574-7c6e5f0831f8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.709522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db7214-2066-41c0-905e-9e699414fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.710807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7214-2066-41c0-905e-9e699414fb10 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.711375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7214-2066-41c0-905e-9e699414fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.711869 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7214-2066-41c0-905e-9e699414fb10 None admin] PATH_INFO: `/v3/users/3ada641875424a12b0f95a539d0bf56a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.713344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db7214-2066-41c0-905e-9e699414fb10 None admin] RBAC: Authorizing `identity:get_user(user_id=3ada641875424a12b0f95a539d0bf56a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:12.715059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db7214-2066-41c0-905e-9e699414fb10 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:12.717372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 188/370] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/users/3ada641875424a12b0f95a539d0bf56a => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:12.718561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db7214-2066-41c0-905e-9e699414fb10 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.759783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.760470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.760754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.761030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.761786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:12.762120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:12.763528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:12.775115 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 183/371] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:12.775948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.833391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:12.844756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db7214-2066-41c0-905e-9e699414fb10 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.896546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.898293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.898293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.898293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.899788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] RBAC: Adding query filter params (group.id=f674afe768ba475c9b7b8cd50adda337, role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:12.900118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:12.901927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:12.910756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 189/372] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/role_assignments?group.id=f674afe768ba475c9b7b8cd50adda337&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:12.911737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:12.914411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f00672-8460-4d29-b80e-8689f584fcde None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:12.915047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:12.965948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b2114-e2e6-4604-891d-ed95f73da05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:12.966906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b2114-e2e6-4604-891d-ed95f73da05c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:12.967191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b2114-e2e6-4604-891d-ed95f73da05c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:12.967468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b2114-e2e6-4604-891d-ed95f73da05c None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:12.969399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b2114-e2e6-4604-891d-ed95f73da05c None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:12.971194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b2114-e2e6-4604-891d-ed95f73da05c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:12.973561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 184/373] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:12.974396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b2114-e2e6-4604-891d-ed95f73da05c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:13.098526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b2114-e2e6-4604-891d-ed95f73da05c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:13.114633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:13.131632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196a024-0194-48d6-9c8d-46e6d4a1d3a3 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:13.145879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389958a-73f6-4c27-953f-58d3002aaeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:13.148058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389958a-73f6-4c27-953f-58d3002aaeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:13.149091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389958a-73f6-4c27-953f-58d3002aaeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:13.149541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389958a-73f6-4c27-953f-58d3002aaeb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:13.199458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:13.200141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:13.200443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:13.200714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:13.201556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] RBAC: Adding query filter params (role.id=84808704b93544b6b353735cb3c5825f, user.id=3ada641875424a12b0f95a539d0bf56a, scope.system=all) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:13.201873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:13.203353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:13.219090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 190/374] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/role_assignments?user.id=3ada641875424a12b0f95a539d0bf56a&scope.system=all&role.id=84808704b93544b6b353735cb3c5825f => generated 510 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:13.220303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:13.297227 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389958a-73f6-4c27-953f-58d3002aaeb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:13.298767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389958a-73f6-4c27-953f-58d3002aaeb3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:13.346551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:13.390291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af6e70-f5f1-443c-91d2-3998751119ff None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:13.429059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b7700-41f1-4111-ba51-d0b3b238f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:13.429926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7700-41f1-4111-ba51-d0b3b238f5bf None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:13.430245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7700-41f1-4111-ba51-d0b3b238f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:13.430528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7700-41f1-4111-ba51-d0b3b238f5bf None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:13.431724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b7700-41f1-4111-ba51-d0b3b238f5bf None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:13.433192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b7700-41f1-4111-ba51-d0b3b238f5bf None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:13.434889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 191/375] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:13 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:13.440814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b7700-41f1-4111-ba51-d0b3b238f5bf None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:13.471373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 185/376] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:13.484232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389958a-73f6-4c27-953f-58d3002aaeb3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:13.510383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:13.607646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b7700-41f1-4111-ba51-d0b3b238f5bf None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:13.662296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:13.673682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:13.674626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:13.674921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:13.675200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:13.676042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] RBAC: Adding query filter params (group.id=f674afe768ba475c9b7b8cd50adda337, role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:13.676358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:13.677848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:13.684969 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 192/377] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:13 2022] GET /identity/v3/role_assignments?group.id=f674afe768ba475c9b7b8cd50adda337&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:13.696333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389958a-73f6-4c27-953f-58d3002aaeb3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:13.773440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e8e99-2be5-4bb0-bf30-6054d35ddf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:13.774384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8e99-2be5-4bb0-bf30-6054d35ddf15 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:13.774673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8e99-2be5-4bb0-bf30-6054d35ddf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:13.774957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8e99-2be5-4bb0-bf30-6054d35ddf15 None admin] PATH_INFO: `/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:13.778885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e8e99-2be5-4bb0-bf30-6054d35ddf15 None admin] RBAC: Authorizing `identity:get_project(project_id=9afd60ec71934d3cbf3f12a53b6e9a17)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:13.780405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e8e99-2be5-4bb0-bf30-6054d35ddf15 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:13.782725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 186/378] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:13 2022] GET /identity/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17 => generated 344 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:13.788308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:13.915469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0c175-3e5d-4858-99c5-6bfa2b6b815b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:13.952443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216ba75-54f5-4c50-97c8-96421710810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:13.953677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ba75-54f5-4c50-97c8-96421710810d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:13.954220 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ba75-54f5-4c50-97c8-96421710810d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:13.954715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ba75-54f5-4c50-97c8-96421710810d None admin] PATH_INFO: `/v3/groups/b539bcda3d204dbb931ca429e4a422c9` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:13.961261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b261d-eb3d-47e4-90a0-a13294c279d8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:13.961564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b261d-eb3d-47e4-90a0-a13294c279d8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:13.961770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216ba75-54f5-4c50-97c8-96421710810d None admin] RBAC: Authorizing `identity:get_group(group_id=b539bcda3d204dbb931ca429e4a422c9)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:13.961869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b261d-eb3d-47e4-90a0-a13294c279d8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:13.963404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216ba75-54f5-4c50-97c8-96421710810d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:13.963506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 187/379] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:13.965347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 193/380] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:13 2022] GET /identity/v3/groups/b539bcda3d204dbb931ca429e4a422c9 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:13.969095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e8091-bba7-4f6a-aadf-f9dc379ccfe1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:13.969383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e8091-bba7-4f6a-aadf-f9dc379ccfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:13.969660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e8091-bba7-4f6a-aadf-f9dc379ccfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:13.970911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216ba75-54f5-4c50-97c8-96421710810d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:13.998905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ab3e8091-bba7-4f6a-aadf-f9dc379ccfe1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:14.000204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ab3e8091-bba7-4f6a-aadf-f9dc379ccfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:14.032944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:14.078352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216ba75-54f5-4c50-97c8-96421710810d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:14.081258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 188/381] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:14.111234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e8091-bba7-4f6a-aadf-f9dc379ccfe1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:14.113104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:14.113770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:14.114095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:14.114381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:14.115757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] RBAC: Adding query filter params (group.id=b539bcda3d204dbb931ca429e4a422c9, role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=9afd60ec71934d3cbf3f12a53b6e9a17) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:14.116075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:14.117642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:14.123985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 194/382] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:13 2022] GET /identity/v3/role_assignments?group.id=b539bcda3d204dbb931ca429e4a422c9&scope.project.id=9afd60ec71934d3cbf3f12a53b6e9a17&role.id=f3f138e4021a4b7dada39089dd427266 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:14.133892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:14.276144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e8091-bba7-4f6a-aadf-f9dc379ccfe1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:14.324222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cfbc5-97dd-4c12-8dab-942bdbba9ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:14.325045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfbc5-97dd-4c12-8dab-942bdbba9ffd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:14.325334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfbc5-97dd-4c12-8dab-942bdbba9ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:14.325609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfbc5-97dd-4c12-8dab-942bdbba9ffd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:14.340349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cfbc5-97dd-4c12-8dab-942bdbba9ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c52cfbc5-97dd-4c12-8dab-942bdbba9ffd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:14.348307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:14.349192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:14.350530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 189/383] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:14.355682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:14.491114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cd0d6-5822-4f56-a5e6-9154e3fb8c07 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:14.513083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:14.553261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:14.553261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:14.553261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:14.553261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:14.553657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:14.553657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:14.553657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:14.553657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 195/384] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:14.553891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cfbc5-97dd-4c12-8dab-942bdbba9ffd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:14.651080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:14.687531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cfbc5-97dd-4c12-8dab-942bdbba9ffd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:14.742220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37e9e-b4c1-41d3-83c9-825784ce43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:14.743090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37e9e-b4c1-41d3-83c9-825784ce43fc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:14.743376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37e9e-b4c1-41d3-83c9-825784ce43fc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:14.743657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37e9e-b4c1-41d3-83c9-825784ce43fc None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:14.749607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c37e9e-b4c1-41d3-83c9-825784ce43fc None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:14.751123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c37e9e-b4c1-41d3-83c9-825784ce43fc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:14.753097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 190/385] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:14 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:14.758320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:14.876055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a8c53-c4af-4e33-9b61-1fa715660cbc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:14.921498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b293f47-39ff-4046-9361-c222a2b2978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:14.922431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b293f47-39ff-4046-9361-c222a2b2978a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:14.922727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b293f47-39ff-4046-9361-c222a2b2978a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:14.923002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b293f47-39ff-4046-9361-c222a2b2978a None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:14.926673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b293f47-39ff-4046-9361-c222a2b2978a None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:14.928187 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b293f47-39ff-4046-9361-c222a2b2978a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:14.930320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 196/386] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:14 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:14.935584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37e9e-b4c1-41d3-83c9-825784ce43fc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:14.981015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655e93-ba35-4e76-8ced-ea224cd7d3e5 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:14.981314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655e93-ba35-4e76-8ced-ea224cd7d3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:14.981578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655e93-ba35-4e76-8ced-ea224cd7d3e5 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:14.982983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 197/387] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:14.988517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264718-9495-4eac-b7af-9e6b661a7c7b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:14.988808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264718-9495-4eac-b7af-9e6b661a7c7b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:14.989085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264718-9495-4eac-b7af-9e6b661a7c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:15.024607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-dc264718-9495-4eac-b7af-9e6b661a7c7b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:15.027283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-dc264718-9495-4eac-b7af-9e6b661a7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:15.121164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:15.145374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 198/388] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:15.150569 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37e9e-b4c1-41d3-83c9-825784ce43fc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:15.184725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264718-9495-4eac-b7af-9e6b661a7c7b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:15.200263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0e4f6-4f58-4507-956e-d0da1d38b69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:15.201155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0e4f6-4f58-4507-956e-d0da1d38b69d None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:15.201440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0e4f6-4f58-4507-956e-d0da1d38b69d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:15.201718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0e4f6-4f58-4507-956e-d0da1d38b69d None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/groups/f674afe768ba475c9b7b8cd50adda337/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:15.208499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0e4f6-4f58-4507-956e-d0da1d38b69d None admin] RBAC: Authorizing `identity:create_grant(project_id=4b08bbe0207849a5b6ee86bad98f3e1a, group_id=f674afe768ba475c9b7b8cd50adda337, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:15.212123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0e4f6-4f58-4507-956e-d0da1d38b69d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:15.305907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264718-9495-4eac-b7af-9e6b661a7c7b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:15.321088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:15.326747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 191/389] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 30 11:56:14 2022] PUT /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/groups/f674afe768ba475c9b7b8cd50adda337/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:15.362395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ffe1d-b367-4f25-93bc-8c51e37fbebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:15.363306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ffe1d-b367-4f25-93bc-8c51e37fbebe None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:15.363596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ffe1d-b367-4f25-93bc-8c51e37fbebe None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:15.363924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ffe1d-b367-4f25-93bc-8c51e37fbebe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:15.381476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ffe1d-b367-4f25-93bc-8c51e37fbebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-430ffe1d-b367-4f25-93bc-8c51e37fbebe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:15.389608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:15.391370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:15.392252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 199/390] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:15.398333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0e4f6-4f58-4507-956e-d0da1d38b69d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:15.538097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0e4f6-4f58-4507-956e-d0da1d38b69d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:15.583888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:15.584567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:15.584855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:15.585136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:15.585896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:15.586266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:15.587660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:15.602337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 192/391] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:15.604177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ffe1d-b367-4f25-93bc-8c51e37fbebe None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:15.648925 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:15.712311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ffe1d-b367-4f25-93bc-8c51e37fbebe None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:15.747497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55eaac2-a47d-4142-9091-70bd7bfcd7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:15.747971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eaac2-a47d-4142-9091-70bd7bfcd7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:15.748258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eaac2-a47d-4142-9091-70bd7bfcd7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:15.748537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eaac2-a47d-4142-9091-70bd7bfcd7a6 None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:15.749718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55eaac2-a47d-4142-9091-70bd7bfcd7a6 None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:15.753982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55eaac2-a47d-4142-9091-70bd7bfcd7a6 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:15.753982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 200/392] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:15 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:15.759102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:15.775848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb510-1eab-4c2b-9266-52f21b96c9e1 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:15.776141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb510-1eab-4c2b-9266-52f21b96c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:15.776410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cb510-1eab-4c2b-9266-52f21b96c9e1 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:15.777915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 201/393] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:56:15.782853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d8d4-b678-42e1-9683-7d29f8d8d0d1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:15.783143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d8d4-b678-42e1-9683-7d29f8d8d0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:15.783423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d8d4-b678-42e1-9683-7d29f8d8d0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:15.807567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-79e0d8d4-b678-42e1-9683-7d29f8d8d0d1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:15.808760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-79e0d8d4-b678-42e1-9683-7d29f8d8d0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:15.869418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:15.923609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 202/394] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:15.934118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef12d75-7282-4ff7-8155-1606190b84f1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:15.960447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0d8d4-b678-42e1-9683-7d29f8d8d0d1 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:15.987199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d44d2-cf58-4317-9ee0-72ddd92a240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:15.988134 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d44d2-cf58-4317-9ee0-72ddd92a240b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:15.988420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d44d2-cf58-4317-9ee0-72ddd92a240b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:15.988695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d44d2-cf58-4317-9ee0-72ddd92a240b None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:15.991703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d44d2-cf58-4317-9ee0-72ddd92a240b None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:15.993454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d44d2-cf58-4317-9ee0-72ddd92a240b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:15.995242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 193/395] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:15 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:16.001523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d44d2-cf58-4317-9ee0-72ddd92a240b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:16.030085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:16.148857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0d8d4-b678-42e1-9683-7d29f8d8d0d1 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:16.184628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d44d2-cf58-4317-9ee0-72ddd92a240b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:16.185111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5ddb8-9901-48e4-82ab-2607619eb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:16.185931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5ddb8-9901-48e4-82ab-2607619eb0ef None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:16.186256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5ddb8-9901-48e4-82ab-2607619eb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:16.186538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5ddb8-9901-48e4-82ab-2607619eb0ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:16.210167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5ddb8-9901-48e4-82ab-2607619eb0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-0ae5ddb8-9901-48e4-82ab-2607619eb0ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:16.223558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:16.225087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:16.225878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:16.227016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 203/396] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:56:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:16.231290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5ddb8-9901-48e4-82ab-2607619eb0ef None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:16.246366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:16.255473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b53f6-2728-4eef-9466-d3b64037dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:16.256476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b53f6-2728-4eef-9466-d3b64037dc25 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:16.256760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b53f6-2728-4eef-9466-d3b64037dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:16.257036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b53f6-2728-4eef-9466-d3b64037dc25 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/groups/f674afe768ba475c9b7b8cd50adda337/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:16.261911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b53f6-2728-4eef-9466-d3b64037dc25 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f, group_id=f674afe768ba475c9b7b8cd50adda337, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:16.263401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b53f6-2728-4eef-9466-d3b64037dc25 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:16.363400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:16.368166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5ddb8-9901-48e4-82ab-2607619eb0ef None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:16.388654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 194/397] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 30 11:56:16 2022] PUT /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/groups/f674afe768ba475c9b7b8cd50adda337/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:16.427499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:16.428262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:16.428554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:16.428836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:16.429614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:16.429928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:16.431480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:16.441902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 204/398] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:16.447869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b53f6-2728-4eef-9466-d3b64037dc25 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:16.583631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b53f6-2728-4eef-9466-d3b64037dc25 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:16.622463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e53062-cb81-4fd0-90b2-e4aab3fa9501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:16.623327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53062-cb81-4fd0-90b2-e4aab3fa9501 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:16.623613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53062-cb81-4fd0-90b2-e4aab3fa9501 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:16.623892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53062-cb81-4fd0-90b2-e4aab3fa9501 None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:16.625068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e53062-cb81-4fd0-90b2-e4aab3fa9501 None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:16.626565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e53062-cb81-4fd0-90b2-e4aab3fa9501 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:16.633200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 195/399] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:16 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:16.634594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:16.754679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d5b49-6d5f-4157-aaab-3a5de0bc5930 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:16.808247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97eb0-54dd-4a6f-b71c-76fdf3e1dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:16.809130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97eb0-54dd-4a6f-b71c-76fdf3e1dc32 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:16.809422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97eb0-54dd-4a6f-b71c-76fdf3e1dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:16.809704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97eb0-54dd-4a6f-b71c-76fdf3e1dc32 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:16.810958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea97eb0-54dd-4a6f-b71c-76fdf3e1dc32 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:16.812430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea97eb0-54dd-4a6f-b71c-76fdf3e1dc32 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:16.814348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 205/400] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:16 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:16.820613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e53062-cb81-4fd0-90b2-e4aab3fa9501 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:16.896859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:16.943901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24a18-92b3-4962-a1f5-dc5936e06caa None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:16.944202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24a18-92b3-4962-a1f5-dc5936e06caa None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:16.944486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d24a18-92b3-4962-a1f5-dc5936e06caa None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:16.946118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 206/401] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:56:16.947003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e53062-cb81-4fd0-90b2-e4aab3fa9501 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:16.953993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb140a1-cc1a-4323-872f-125d32a429b6 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:16.953993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb140a1-cc1a-4323-872f-125d32a429b6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:16.953993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb140a1-cc1a-4323-872f-125d32a429b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:16.976146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8bb140a1-cc1a-4323-872f-125d32a429b6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:16.978250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8bb140a1-cc1a-4323-872f-125d32a429b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:16.986423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0c42-84a5-42b3-bb33-1013be5f31ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:16.987561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0c42-84a5-42b3-bb33-1013be5f31ee None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:16.988367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0c42-84a5-42b3-bb33-1013be5f31ee None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:16.989139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0c42-84a5-42b3-bb33-1013be5f31ee None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/groups/f674afe768ba475c9b7b8cd50adda337/roles/961dfd3ce0344659aaf2e9c80164893e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:16.992751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df0c42-84a5-42b3-bb33-1013be5f31ee None admin] RBAC: Authorizing `identity:create_grant(project_id=4b08bbe0207849a5b6ee86bad98f3e1a, group_id=f674afe768ba475c9b7b8cd50adda337, role_id=961dfd3ce0344659aaf2e9c80164893e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:16.994239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df0c42-84a5-42b3-bb33-1013be5f31ee None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:17.008679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:17.053532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 207/402] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:17.054689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30af25-ff97-47d5-8557-56e9b3e91880 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:17.060537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30af25-ff97-47d5-8557-56e9b3e91880 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:17.060537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30af25-ff97-47d5-8557-56e9b3e91880 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:17.060537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 208/403] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:17.062097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0688c3e-324c-4670-924d-d6a1875fcbe1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:17.062390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0688c3e-324c-4670-924d-d6a1875fcbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:17.062671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0688c3e-324c-4670-924d-d6a1875fcbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:17.075019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 196/404] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 30 11:56:16 2022] PUT /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a/groups/f674afe768ba475c9b7b8cd50adda337/roles/961dfd3ce0344659aaf2e9c80164893e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:17.087194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b0688c3e-324c-4670-924d-d6a1875fcbe1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:17.089457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b0688c3e-324c-4670-924d-d6a1875fcbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:17.108359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0c42-84a5-42b3-bb33-1013be5f31ee None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:17.173648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 209/405] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:17.216056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0688c3e-324c-4670-924d-d6a1875fcbe1 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:17.273125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0c42-84a5-42b3-bb33-1013be5f31ee None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:17.295466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:17.320504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:17.328326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd74e15-9642-44f3-9bde-8374031ed069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:17.329138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74e15-9642-44f3-9bde-8374031ed069 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:17.329427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74e15-9642-44f3-9bde-8374031ed069 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:17.329711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74e15-9642-44f3-9bde-8374031ed069 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:17.337567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0688c3e-324c-4670-924d-d6a1875fcbe1 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:17.345003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd74e15-9642-44f3-9bde-8374031ed069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6bd74e15-9642-44f3-9bde-8374031ed069 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:17.360987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:17.361905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:17.362738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 197/406] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:17.364370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd74e15-9642-44f3-9bde-8374031ed069 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:17.387062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497b1c2-3b31-4042-b52a-2827fad0b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:17.388558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b1c2-3b31-4042-b52a-2827fad0b78b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:17.389048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b1c2-3b31-4042-b52a-2827fad0b78b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:17.389562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b1c2-3b31-4042-b52a-2827fad0b78b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:17.401211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497b1c2-3b31-4042-b52a-2827fad0b78b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-d497b1c2-3b31-4042-b52a-2827fad0b78b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:17.409759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:17.410769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:17.411579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:17.414036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 210/407] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:56:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:17.417500 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497b1c2-3b31-4042-b52a-2827fad0b78b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:17.495359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd74e15-9642-44f3-9bde-8374031ed069 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:17.534151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:17.534833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:17.535199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:17.535541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:17.536411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:17.536772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:17.538295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:17.551845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 198/408] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:17.553136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:17.555741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497b1c2-3b31-4042-b52a-2827fad0b78b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:17.600271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:17.601060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:17.601462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:17.601706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:17.602555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:17.602867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:17.603905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:17.604333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:17.618108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 211/409] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:17.620062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:17.634455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:17.686125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fccbfb-d397-4b9c-88c3-ac54eb0af731 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:17.762225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4c21f-b939-4bd6-8e63-b70bcfc4456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:17.763097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4c21f-b939-4bd6-8e63-b70bcfc4456d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:17.763384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4c21f-b939-4bd6-8e63-b70bcfc4456d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:17.763662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4c21f-b939-4bd6-8e63-b70bcfc4456d None admin] PATH_INFO: `/v3/groups/b539bcda3d204dbb931ca429e4a422c9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:17.764842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4c21f-b939-4bd6-8e63-b70bcfc4456d None admin] RBAC: Authorizing `identity:get_group(group_id=b539bcda3d204dbb931ca429e4a422c9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:17.766390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4c21f-b939-4bd6-8e63-b70bcfc4456d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:17.768021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 199/410] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:17 2022] GET /identity/v3/groups/b539bcda3d204dbb931ca429e4a422c9 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:17.786770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4c21f-b939-4bd6-8e63-b70bcfc4456d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:17.810118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e3f1-a2e7-4b9c-a081-507055aa3864 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:17.886948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4e6a-041f-4b1d-bded-f726740290b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:17.887809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4e6a-041f-4b1d-bded-f726740290b9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:17.888095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4e6a-041f-4b1d-bded-f726740290b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:17.888372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4e6a-041f-4b1d-bded-f726740290b9 None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:17.889856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b4e6a-041f-4b1d-bded-f726740290b9 None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:17.891346 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b4e6a-041f-4b1d-bded-f726740290b9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:17.903683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 212/411] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:17 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:17.907471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4e6a-041f-4b1d-bded-f726740290b9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:17.961755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4c21f-b939-4bd6-8e63-b70bcfc4456d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:17.971678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:18.010955 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:18.033643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4e6a-041f-4b1d-bded-f726740290b9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:18.051652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c3579-6875-4ba0-97c9-97b2e0a33cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:18.053050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c3579-6875-4ba0-97c9-97b2e0a33cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:18.053334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c3579-6875-4ba0-97c9-97b2e0a33cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:18.053606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c3579-6875-4ba0-97c9-97b2e0a33cf9 None admin] PATH_INFO: `/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:18.058693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c3579-6875-4ba0-97c9-97b2e0a33cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=9afd60ec71934d3cbf3f12a53b6e9a17)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:18.060155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c3579-6875-4ba0-97c9-97b2e0a33cf9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:18.062240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 200/412] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:17 2022] GET /identity/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17 => generated 344 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:18.074472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252159-71cc-4f03-b156-a4f97437c819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:18.075345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252159-71cc-4f03-b156-a4f97437c819 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:18.075633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252159-71cc-4f03-b156-a4f97437c819 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:18.075912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252159-71cc-4f03-b156-a4f97437c819 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:18.077114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14252159-71cc-4f03-b156-a4f97437c819 None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:18.078757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14252159-71cc-4f03-b156-a4f97437c819 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:18.079787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c3579-6875-4ba0-97c9-97b2e0a33cf9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:18.085245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 213/413] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:17 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:18.086505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252159-71cc-4f03-b156-a4f97437c819 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:18.215784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c3579-6875-4ba0-97c9-97b2e0a33cf9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:18.227561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252159-71cc-4f03-b156-a4f97437c819 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:18.252449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a801b-f0c8-4ee5-92d9-d720c518cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:18.253337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a801b-f0c8-4ee5-92d9-d720c518cd68 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:18.253625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a801b-f0c8-4ee5-92d9-d720c518cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:18.253905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a801b-f0c8-4ee5-92d9-d720c518cd68 None admin] PATH_INFO: `/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17/groups/b539bcda3d204dbb931ca429e4a422c9/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:18.255947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a801b-f0c8-4ee5-92d9-d720c518cd68 None admin] RBAC: Authorizing `identity:create_grant(project_id=9afd60ec71934d3cbf3f12a53b6e9a17, group_id=b539bcda3d204dbb931ca429e4a422c9, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:18.257394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a801b-f0c8-4ee5-92d9-d720c518cd68 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:18.271653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ff42c-40a5-42bc-951b-142f37646200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:18.274459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ff42c-40a5-42bc-951b-142f37646200 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:18.274459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ff42c-40a5-42bc-951b-142f37646200 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:18.274459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ff42c-40a5-42bc-951b-142f37646200 None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/groups/f674afe768ba475c9b7b8cd50adda337/roles/961dfd3ce0344659aaf2e9c80164893e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:18.276226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ff42c-40a5-42bc-951b-142f37646200 None admin] RBAC: Authorizing `identity:create_grant(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f, group_id=f674afe768ba475c9b7b8cd50adda337, role_id=961dfd3ce0344659aaf2e9c80164893e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:18.277919 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ff42c-40a5-42bc-951b-142f37646200 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:18.331393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 201/414] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 30 11:56:18 2022] PUT /identity/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17/groups/b539bcda3d204dbb931ca429e4a422c9/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:18.332594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ab65-f5eb-4798-bb40-12f5ffe69fbc None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:18.332890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ab65-f5eb-4798-bb40-12f5ffe69fbc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:18.333175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ab65-f5eb-4798-bb40-12f5ffe69fbc None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:18.334764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 202/415] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:18.346207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ededa7-1346-4416-9550-8dca7759b787 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:18.346521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ededa7-1346-4416-9550-8dca7759b787 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:18.346794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ededa7-1346-4416-9550-8dca7759b787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:18.367890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a0ededa7-1346-4416-9550-8dca7759b787 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:18.369163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a0ededa7-1346-4416-9550-8dca7759b787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:18.386777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 214/416] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 30 11:56:18 2022] PUT /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f/groups/f674afe768ba475c9b7b8cd50adda337/roles/961dfd3ce0344659aaf2e9c80164893e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:56:18.414850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:18.478120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 203/417] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:18.523651 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ff42c-40a5-42bc-951b-142f37646200 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:18.535344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:18.652188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ff42c-40a5-42bc-951b-142f37646200 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:18.700469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6d0f2-0447-4800-9c9d-6741d20cb020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:18.701302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6d0f2-0447-4800-9c9d-6741d20cb020 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:18.701591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6d0f2-0447-4800-9c9d-6741d20cb020 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:18.701872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6d0f2-0447-4800-9c9d-6741d20cb020 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:18.718288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6d0f2-0447-4800-9c9d-6741d20cb020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-6df6d0f2-0447-4800-9c9d-6741d20cb020 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:18.726758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:18.727620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:18.728426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 215/418] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:18.735105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ededa7-1346-4416-9550-8dca7759b787 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:18.848681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ededa7-1346-4416-9550-8dca7759b787 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:18.884719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38e721-b0dc-40c7-8f38-e3256ce2d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:18.885736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38e721-b0dc-40c7-8f38-e3256ce2d154 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:18.886349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38e721-b0dc-40c7-8f38-e3256ce2d154 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:18.886845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38e721-b0dc-40c7-8f38-e3256ce2d154 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:18.887859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38e721-b0dc-40c7-8f38-e3256ce2d154 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:18.888364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38e721-b0dc-40c7-8f38-e3256ce2d154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:18.889942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38e721-b0dc-40c7-8f38-e3256ce2d154 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:18.899971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 204/419] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:18.905369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6d0f2-0447-4800-9c9d-6741d20cb020 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:19.001431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:19.023738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87b789-7623-49ed-80d3-04725b29bc3f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:19.024037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87b789-7623-49ed-80d3-04725b29bc3f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:19.024323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87b789-7623-49ed-80d3-04725b29bc3f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:19.025936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 205/420] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:19.031111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48d8d7-87b9-4785-a182-cf92cbbc8924 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:19.031400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48d8d7-87b9-4785-a182-cf92cbbc8924 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:19.031682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48d8d7-87b9-4785-a182-cf92cbbc8924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:19.042110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6d0f2-0447-4800-9c9d-6741d20cb020 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:19.064262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6a48d8d7-87b9-4785-a182-cf92cbbc8924 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:19.065768 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6a48d8d7-87b9-4785-a182-cf92cbbc8924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:19.086306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3e3e1-45fc-4f9e-90e4-305b2d6d7c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:19.086972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3e3e1-45fc-4f9e-90e4-305b2d6d7c92 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:19.087263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3e3e1-45fc-4f9e-90e4-305b2d6d7c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:19.087546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3e3e1-45fc-4f9e-90e4-305b2d6d7c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:19.094626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:19.149657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 206/421] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:19.169944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3e3e1-45fc-4f9e-90e4-305b2d6d7c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:19.171383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3e3e1-45fc-4f9e-90e4-305b2d6d7c92 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:19.181502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48d8d7-87b9-4785-a182-cf92cbbc8924 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:19.251738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:19.311080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48d8d7-87b9-4785-a182-cf92cbbc8924 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:19.338601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 216/422] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:19.344565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3e3e1-45fc-4f9e-90e4-305b2d6d7c92 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:19.367336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85465-9a70-4c85-8ddc-a1463c5290a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:19.368507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85465-9a70-4c85-8ddc-a1463c5290a0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:19.369004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85465-9a70-4c85-8ddc-a1463c5290a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:19.369487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85465-9a70-4c85-8ddc-a1463c5290a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:19.380840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae85465-9a70-4c85-8ddc-a1463c5290a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1ae85465-9a70-4c85-8ddc-a1463c5290a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:19.389145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:19.390121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 30 11:56:19.390893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:19.393532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 207/423] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:19.400088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85465-9a70-4c85-8ddc-a1463c5290a0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:19.437789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:19.558737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3e3e1-45fc-4f9e-90e4-305b2d6d7c92 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:19.597483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85465-9a70-4c85-8ddc-a1463c5290a0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:19.623350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bdccf-53eb-4a2a-9fa0-e10147c37e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:19.624644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bdccf-53eb-4a2a-9fa0-e10147c37e83 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:19.627150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bdccf-53eb-4a2a-9fa0-e10147c37e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:19.627696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bdccf-53eb-4a2a-9fa0-e10147c37e83 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:19.630327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bdccf-53eb-4a2a-9fa0-e10147c37e83 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:19.634580 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bdccf-53eb-4a2a-9fa0-e10147c37e83 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:19.640735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 217/424] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:19 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:19.643583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bdccf-53eb-4a2a-9fa0-e10147c37e83 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:19.668871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:19.669565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:19.669851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:19.670176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:19.670941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:19.671250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:19.672663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:19.688711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 208/425] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:56:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:19.695345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:19.716897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:19.801830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:19.825483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa977-bcdb-4ee5-ad72-2427e75e3e0d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:19.855606 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bdccf-53eb-4a2a-9fa0-e10147c37e83 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:19.874183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c080a82-6e83-4fa2-8ad9-0fcb0ac4505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:19.874911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c080a82-6e83-4fa2-8ad9-0fcb0ac4505c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:19.875207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c080a82-6e83-4fa2-8ad9-0fcb0ac4505c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:19.875561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c080a82-6e83-4fa2-8ad9-0fcb0ac4505c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:19.893435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a8a89-8c8e-4c3a-89e1-7a1596e96009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:19.894340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a8a89-8c8e-4c3a-89e1-7a1596e96009 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:19.894625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a8a89-8c8e-4c3a-89e1-7a1596e96009 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:19.894902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a8a89-8c8e-4c3a-89e1-7a1596e96009 None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:19.896132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a8a89-8c8e-4c3a-89e1-7a1596e96009 None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:19.897627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a8a89-8c8e-4c3a-89e1-7a1596e96009 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:19.904278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 218/426] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:19 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:19.905518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a8a89-8c8e-4c3a-89e1-7a1596e96009 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:20.014665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c080a82-6e83-4fa2-8ad9-0fcb0ac4505c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:20.016137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c080a82-6e83-4fa2-8ad9-0fcb0ac4505c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:20.070756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a8a89-8c8e-4c3a-89e1-7a1596e96009 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:20.072687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:20.105470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b6c85-82bb-4755-924f-95be3765e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:20.106157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6c85-82bb-4755-924f-95be3765e19c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.106440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6c85-82bb-4755-924f-95be3765e19c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.106724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6c85-82bb-4755-924f-95be3765e19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:20.107889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6c85-82bb-4755-924f-95be3765e19c None admin] RBAC: Adding query filter params (group.id=f674afe768ba475c9b7b8cd50adda337, role.id=ec78785738f441ec9be64e122e252506, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:20.108505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6c85-82bb-4755-924f-95be3765e19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:20.110807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6c85-82bb-4755-924f-95be3765e19c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:20.118006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 219/427] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:19 2022] GET /identity/v3/role_assignments?group.id=f674afe768ba475c9b7b8cd50adda337&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=ec78785738f441ec9be64e122e252506 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:20.119009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd66fa-aae1-4e3e-bfcc-c533fa0e284b None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.119372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd66fa-aae1-4e3e-bfcc-c533fa0e284b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.119722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd66fa-aae1-4e3e-bfcc-c533fa0e284b None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:20.121222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 220/428] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:20.126818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:20.126980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacc540-ab2e-4d1e-8f8a-b099780e413c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.127134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacc540-ab2e-4d1e-8f8a-b099780e413c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.131983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacc540-ab2e-4d1e-8f8a-b099780e413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:20.155691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2cacc540-ab2e-4d1e-8f8a-b099780e413c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:20.156919 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2cacc540-ab2e-4d1e-8f8a-b099780e413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:20.174715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 209/429] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:20.183860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c080a82-6e83-4fa2-8ad9-0fcb0ac4505c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:20.308732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 221/430] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:20.347577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c080a82-6e83-4fa2-8ad9-0fcb0ac4505c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:20.365912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacc540-ab2e-4d1e-8f8a-b099780e413c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:20.388165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57054ad-5eea-44f3-a13d-86fd9b676eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:20.389179 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57054ad-5eea-44f3-a13d-86fd9b676eaf None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.389570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57054ad-5eea-44f3-a13d-86fd9b676eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.389996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57054ad-5eea-44f3-a13d-86fd9b676eaf None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:20.391933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57054ad-5eea-44f3-a13d-86fd9b676eaf None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:20.393570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57054ad-5eea-44f3-a13d-86fd9b676eaf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:20.396423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 210/431] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:20 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:20.402514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57054ad-5eea-44f3-a13d-86fd9b676eaf None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:20.465148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:20.483638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:20.491447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacc540-ab2e-4d1e-8f8a-b099780e413c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:20.534336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ba60f-9981-4891-8198-6fb1c8c15ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:20.535413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba60f-9981-4891-8198-6fb1c8c15ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.535865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba60f-9981-4891-8198-6fb1c8c15ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.536279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba60f-9981-4891-8198-6fb1c8c15ea8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:20.537352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57054ad-5eea-44f3-a13d-86fd9b676eaf None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:20.553630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ba60f-9981-4891-8198-6fb1c8c15ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-af6ba60f-9981-4891-8198-6fb1c8c15ea8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:20.561927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:20.563298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:20.568686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 222/432] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:20.572825 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ba60f-9981-4891-8198-6fb1c8c15ea8 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:20.593700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8a934-43f9-4807-be99-6a66aa982fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:20.595599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8a934-43f9-4807-be99-6a66aa982fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.596112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8a934-43f9-4807-be99-6a66aa982fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.596586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8a934-43f9-4807-be99-6a66aa982fe7 None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:20.598062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8a934-43f9-4807-be99-6a66aa982fe7 None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:20.601110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8a934-43f9-4807-be99-6a66aa982fe7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:20.603494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 211/433] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:20 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:20.608910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8a934-43f9-4807-be99-6a66aa982fe7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:20.699216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ba60f-9981-4891-8198-6fb1c8c15ea8 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:20.745352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8a934-43f9-4807-be99-6a66aa982fe7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:20.757947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:20.759339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.759632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.759911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:20.760705 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:20.761015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:20.765190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:20.778066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 223/434] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:20.778634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:20.781864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:20.807829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e93a0-e12e-489b-84b7-ca91dbf7b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:20.809145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e93a0-e12e-489b-84b7-ca91dbf7b7cd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.809650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e93a0-e12e-489b-84b7-ca91dbf7b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.811592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e93a0-e12e-489b-84b7-ca91dbf7b7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:20.812182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:20.812651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e93a0-e12e-489b-84b7-ca91dbf7b7cd None admin] RBAC: Adding query filter params (group.id=f674afe768ba475c9b7b8cd50adda337, role.id=ec78785738f441ec9be64e122e252506, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:20.813019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e93a0-e12e-489b-84b7-ca91dbf7b7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:20.814890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e93a0-e12e-489b-84b7-ca91dbf7b7cd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:20.827359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 212/435] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:20 2022] GET /identity/v3/role_assignments?group.id=f674afe768ba475c9b7b8cd50adda337&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=ec78785738f441ec9be64e122e252506 => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:20.911689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e1329-375e-42fd-a403-40919ad9e9e1 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:20.950533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d0bf-fcc0-4c94-97ec-b48247766ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:20.951476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d0bf-fcc0-4c94-97ec-b48247766ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:20.951926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d0bf-fcc0-4c94-97ec-b48247766ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:20.952349 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d0bf-fcc0-4c94-97ec-b48247766ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.030645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880d0bf-fcc0-4c94-97ec-b48247766ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:21.032375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880d0bf-fcc0-4c94-97ec-b48247766ca0 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:21.052260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:21.098301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6ab6-455a-4448-b615-cdc0fa6d5cbf None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.098521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6ab6-455a-4448-b615-cdc0fa6d5cbf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.098811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6ab6-455a-4448-b615-cdc0fa6d5cbf None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.100511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 213/436] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:21.105741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c154c7-49f4-4733-ad0f-92b5f9fa7e5d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.106115 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c154c7-49f4-4733-ad0f-92b5f9fa7e5d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.106338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c154c7-49f4-4733-ad0f-92b5f9fa7e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.136784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-54c154c7-49f4-4733-ad0f-92b5f9fa7e5d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:21.138014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-54c154c7-49f4-4733-ad0f-92b5f9fa7e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:21.147419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 224/437] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:21.149878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af189-dfd0-46fb-b9a8-e7d4d60d5bfd None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.150268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af189-dfd0-46fb-b9a8-e7d4d60d5bfd None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.150550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af189-dfd0-46fb-b9a8-e7d4d60d5bfd None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.152085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 225/438] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:21.155216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af189-dfd0-46fb-b9a8-e7d4d60d5bfd None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.215234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 214/439] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:21.216596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc47f-aaa2-4a73-b161-7865adb73673 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.216903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc47f-aaa2-4a73-b161-7865adb73673 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.217168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc47f-aaa2-4a73-b161-7865adb73673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.236953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2f9bc47f-aaa2-4a73-b161-7865adb73673 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:21.238166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2f9bc47f-aaa2-4a73-b161-7865adb73673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:21.259173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af189-dfd0-46fb-b9a8-e7d4d60d5bfd None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.276496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:21.292375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edafd08-031b-458a-98f2-76c5cc0e9870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.293224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edafd08-031b-458a-98f2-76c5cc0e9870 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.293506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edafd08-031b-458a-98f2-76c5cc0e9870 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.293782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edafd08-031b-458a-98f2-76c5cc0e9870 None admin] PATH_INFO: `/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.294990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edafd08-031b-458a-98f2-76c5cc0e9870 None admin] RBAC: Authorizing `identity:get_project(project_id=4b08bbe0207849a5b6ee86bad98f3e1a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:21.296441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edafd08-031b-458a-98f2-76c5cc0e9870 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:21.298145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 226/440] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/projects/4b08bbe0207849a5b6ee86bad98f3e1a => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:21.299017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edafd08-031b-458a-98f2-76c5cc0e9870 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.309783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 215/441] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:21.310651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc47f-aaa2-4a73-b161-7865adb73673 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.351251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:21.397813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edafd08-031b-458a-98f2-76c5cc0e9870 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.410369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc47f-aaa2-4a73-b161-7865adb73673 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.431143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715d9e7-95c4-401a-931e-03d89f4c139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.431949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715d9e7-95c4-401a-931e-03d89f4c139d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.432242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715d9e7-95c4-401a-931e-03d89f4c139d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.432527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715d9e7-95c4-401a-931e-03d89f4c139d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.442558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715d9e7-95c4-401a-931e-03d89f4c139d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:21.443830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe24-0dcb-4a34-ada0-5cb4ce9f14c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.444676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe24-0dcb-4a34-ada0-5cb4ce9f14c7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.444959 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe24-0dcb-4a34-ada0-5cb4ce9f14c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.445233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe24-0dcb-4a34-ada0-5cb4ce9f14c7 None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.446698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fbe24-0dcb-4a34-ada0-5cb4ce9f14c7 None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:21.448144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fbe24-0dcb-4a34-ada0-5cb4ce9f14c7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:21.449745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 216/442] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:21.450524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe24-0dcb-4a34-ada0-5cb4ce9f14c7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-6715d9e7-95c4-401a-931e-03d89f4c139d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:21.451803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:21.452855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:21.453883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 227/443] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:21.457153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715d9e7-95c4-401a-931e-03d89f4c139d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.502458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:21.551262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe24-0dcb-4a34-ada0-5cb4ce9f14c7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.554466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715d9e7-95c4-401a-931e-03d89f4c139d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.558832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:21.586119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547d76-5f11-42e0-a2dc-e9f037094816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.587095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547d76-5f11-42e0-a2dc-e9f037094816 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.587446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547d76-5f11-42e0-a2dc-e9f037094816 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.587537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.588014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547d76-5f11-42e0-a2dc-e9f037094816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.588103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.588376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.588655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.589485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] RBAC: Adding query filter params (group.id=f674afe768ba475c9b7b8cd50adda337, role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:21.589799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:21.591264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:21.597170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 228/444] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/role_assignments?group.id=f674afe768ba475c9b7b8cd50adda337&scope.project.id=4b08bbe0207849a5b6ee86bad98f3e1a&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:21.597712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.598139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c547d76-5f11-42e0-a2dc-e9f037094816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8c547d76-5f11-42e0-a2dc-e9f037094816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:21.606278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:21.607203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:21.608000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 217/445] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:21.616471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547d76-5f11-42e0-a2dc-e9f037094816 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.724554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798628-c8bb-4541-b4b0-12c35538cf4c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.733755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547d76-5f11-42e0-a2dc-e9f037094816 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.736351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:21.763100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.763785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.764072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.764364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.765380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:21.765484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:21.766888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:21.777767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.778577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.778939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.779293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.780131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:21.780808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 229/446] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:21.780923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:21.781672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.782408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:21.793726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 218/447] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:21.799859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:21.833805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:21.903986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cc5e2-95fa-4481-b019-34c68015ad4d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.920757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62ad52-eecb-4ab7-9516-1beb62eda6a7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:21.943578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfe453-877d-4feb-b412-d004c69e8961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.945999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe453-877d-4feb-b412-d004c69e8961 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.945999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe453-877d-4feb-b412-d004c69e8961 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.945999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe453-877d-4feb-b412-d004c69e8961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.958707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d47a3e-5c53-4d9f-a394-fd4198854a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:21.959366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d47a3e-5c53-4d9f-a394-fd4198854a60 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:21.959657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d47a3e-5c53-4d9f-a394-fd4198854a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:21.959940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d47a3e-5c53-4d9f-a394-fd4198854a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:21.992203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:22.030074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfe453-877d-4feb-b412-d004c69e8961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:22.031817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfe453-877d-4feb-b412-d004c69e8961 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:22.042448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d47a3e-5c53-4d9f-a394-fd4198854a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:22.043939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d47a3e-5c53-4d9f-a394-fd4198854a60 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:22.075501 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:22.149502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 230/448] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:22.154454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfe453-877d-4feb-b412-d004c69e8961 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:22.158534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 219/449] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:22.164432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d47a3e-5c53-4d9f-a394-fd4198854a60 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:22.226456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:22.254878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfe453-877d-4feb-b412-d004c69e8961 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:22.262390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d47a3e-5c53-4d9f-a394-fd4198854a60 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:22.288620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821a4b1-5414-481c-94de-e6308a43aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:22.288935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:22.289480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a4b1-5414-481c-94de-e6308a43aaec None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:22.289759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a4b1-5414-481c-94de-e6308a43aaec None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:22.290066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a4b1-5414-481c-94de-e6308a43aaec None admin] PATH_INFO: `/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:22.291232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821a4b1-5414-481c-94de-e6308a43aaec None admin] RBAC: Authorizing `identity:get_project(project_id=77d3c167bfbd49fc986d3ee4f9ecf94f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:22.292661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821a4b1-5414-481c-94de-e6308a43aaec None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:22.294394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 231/450] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:22 2022] GET /identity/v3/projects/77d3c167bfbd49fc986d3ee4f9ecf94f => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:22.297018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae799e9-60c1-4eff-ad5d-3b0dcb9022bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:22.297862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae799e9-60c1-4eff-ad5d-3b0dcb9022bf None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:22.298176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae799e9-60c1-4eff-ad5d-3b0dcb9022bf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:22.298541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae799e9-60c1-4eff-ad5d-3b0dcb9022bf None admin] PATH_INFO: `/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:22.299776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae799e9-60c1-4eff-ad5d-3b0dcb9022bf None admin] RBAC: Authorizing `identity:get_project(project_id=9afd60ec71934d3cbf3f12a53b6e9a17)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:22.299920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821a4b1-5414-481c-94de-e6308a43aaec None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:22.301209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae799e9-60c1-4eff-ad5d-3b0dcb9022bf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:22.303119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 220/451] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:56:22 2022] GET /identity/v3/projects/9afd60ec71934d3cbf3f12a53b6e9a17 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:22.308143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae799e9-60c1-4eff-ad5d-3b0dcb9022bf None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:22.405280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821a4b1-5414-481c-94de-e6308a43aaec None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:22.409478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae799e9-60c1-4eff-ad5d-3b0dcb9022bf None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:22.437646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded13d8f-b156-4208-97db-9fc23cb5df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:22.438512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded13d8f-b156-4208-97db-9fc23cb5df1c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:22.438792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded13d8f-b156-4208-97db-9fc23cb5df1c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:22.439065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded13d8f-b156-4208-97db-9fc23cb5df1c None admin] PATH_INFO: `/v3/groups/f674afe768ba475c9b7b8cd50adda337` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:22.440217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded13d8f-b156-4208-97db-9fc23cb5df1c None admin] RBAC: Authorizing `identity:get_group(group_id=f674afe768ba475c9b7b8cd50adda337)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:22.441642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded13d8f-b156-4208-97db-9fc23cb5df1c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:22.443296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 232/452] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:22 2022] GET /identity/v3/groups/f674afe768ba475c9b7b8cd50adda337 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:22.443813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ed23-362f-4ec2-8ffb-ef333a3be767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:22.444728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ed23-362f-4ec2-8ffb-ef333a3be767 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:22.445017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ed23-362f-4ec2-8ffb-ef333a3be767 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:22.445294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ed23-362f-4ec2-8ffb-ef333a3be767 None admin] PATH_INFO: `/v3/groups/b539bcda3d204dbb931ca429e4a422c9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:22.446755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ed23-362f-4ec2-8ffb-ef333a3be767 None admin] RBAC: Authorizing `identity:get_group(group_id=b539bcda3d204dbb931ca429e4a422c9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:22.448311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ed23-362f-4ec2-8ffb-ef333a3be767 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:22.449082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded13d8f-b156-4208-97db-9fc23cb5df1c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:22.454519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 221/453] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 30 11:56:22 2022] GET /identity/v3/groups/b539bcda3d204dbb931ca429e4a422c9 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:22.455283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ed23-362f-4ec2-8ffb-ef333a3be767 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:22.459596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:22.515027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:22.549676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded13d8f-b156-4208-97db-9fc23cb5df1c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:22.551246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ed23-362f-4ec2-8ffb-ef333a3be767 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:22.582857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb20b6-2af3-4746-bd46-efaecd1bff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:22.584098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb20b6-2af3-4746-bd46-efaecd1bff20 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:22.584385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb20b6-2af3-4746-bd46-efaecd1bff20 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:22.584661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb20b6-2af3-4746-bd46-efaecd1bff20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:22.585053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84695c90-3a9a-4fd4-9ae1-690c48202b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:22.585485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb20b6-2af3-4746-bd46-efaecd1bff20 None admin] RBAC: Adding query filter params (group.id=f674afe768ba475c9b7b8cd50adda337, role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:22.585689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695c90-3a9a-4fd4-9ae1-690c48202b4f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:22.585797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb20b6-2af3-4746-bd46-efaecd1bff20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:22.585996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695c90-3a9a-4fd4-9ae1-690c48202b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:22.586293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84695c90-3a9a-4fd4-9ae1-690c48202b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:22.587107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84695c90-3a9a-4fd4-9ae1-690c48202b4f None admin] RBAC: Adding query filter params (group.id=b539bcda3d204dbb931ca429e4a422c9, role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=9afd60ec71934d3cbf3f12a53b6e9a17) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:22.587264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb20b6-2af3-4746-bd46-efaecd1bff20 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:22.587413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84695c90-3a9a-4fd4-9ae1-690c48202b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:22.588821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84695c90-3a9a-4fd4-9ae1-690c48202b4f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:22.593063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 233/454] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:22 2022] GET /identity/v3/role_assignments?group.id=f674afe768ba475c9b7b8cd50adda337&scope.project.id=77d3c167bfbd49fc986d3ee4f9ecf94f&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:22.596424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 222/455] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 30 11:56:22 2022] GET /identity/v3/role_assignments?group.id=b539bcda3d204dbb931ca429e4a422c9&scope.project.id=9afd60ec71934d3cbf3f12a53b6e9a17&role.id=f3f138e4021a4b7dada39089dd427266 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:25.412400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079b1d-0b30-4703-bdec-71043952dda6 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.413440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079b1d-0b30-4703-bdec-71043952dda6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.413923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079b1d-0b30-4703-bdec-71043952dda6 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.415760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 234/456] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:25.421331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761198-57af-4f7e-a62d-155d2111c73d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.422132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761198-57af-4f7e-a62d-155d2111c73d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.427525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761198-57af-4f7e-a62d-155d2111c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.445620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-08761198-57af-4f7e-a62d-155d2111c73d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:25.447343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-08761198-57af-4f7e-a62d-155d2111c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:25.540327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 223/457] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:25.588625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079b1d-0b30-4703-bdec-71043952dda6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:25.680226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:25.694881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f86e2-e227-4a77-a4ec-5eb263f3dc35 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.696430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f86e2-e227-4a77-a4ec-5eb263f3dc35 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.696430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f86e2-e227-4a77-a4ec-5eb263f3dc35 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.698139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 224/458] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:25.703783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bdfc2-7bfb-42ea-b2ad-58ecae16424e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.704361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bdfc2-7bfb-42ea-b2ad-58ecae16424e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.704830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bdfc2-7bfb-42ea-b2ad-58ecae16424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.713848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079b1d-0b30-4703-bdec-71043952dda6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:25.773650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c517c9a-ce78-4ef9-ad29-4abe8328c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:25.774879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517c9a-ce78-4ef9-ad29-4abe8328c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.775382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517c9a-ce78-4ef9-ad29-4abe8328c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.775854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c517c9a-ce78-4ef9-ad29-4abe8328c5d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.788696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c517c9a-ce78-4ef9-ad29-4abe8328c5d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:25.790563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c517c9a-ce78-4ef9-ad29-4abe8328c5d9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-7c517c9a-ce78-4ef9-ad29-4abe8328c5d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:25.811943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:25.812866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:25.813702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:25.813702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:25.813702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:25.813702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:25.820795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 235/459] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:25.822991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4569ca-77f5-45c2-892f-df00b6d4a21b None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.823525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4569ca-77f5-45c2-892f-df00b6d4a21b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.824005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4569ca-77f5-45c2-892f-df00b6d4a21b None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.825898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 236/460] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:25.826915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4569ca-77f5-45c2-892f-df00b6d4a21b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:25.869900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ef9bdfc2-7bfb-42ea-b2ad-58ecae16424e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:25.871128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ef9bdfc2-7bfb-42ea-b2ad-58ecae16424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:25.927691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:25.950166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 225/461] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:25.950324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4569ca-77f5-45c2-892f-df00b6d4a21b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:25.950401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c7ee-bb3d-4faa-ba85-e58c632fb2ba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:25.950401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c7ee-bb3d-4faa-ba85-e58c632fb2ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:25.950401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c7ee-bb3d-4faa-ba85-e58c632fb2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:25.960444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8461c7ee-bb3d-4faa-ba85-e58c632fb2ba None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:25.961621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8461c7ee-bb3d-4faa-ba85-e58c632fb2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:25.993319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.005123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.007418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.007418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.007418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.007893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:26.008386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.010015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.023439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 237/462] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:26.029352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.035069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 226/463] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:26.038020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461c7ee-bb3d-4faa-ba85-e58c632fb2ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.142088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461c7ee-bb3d-4faa-ba85-e58c632fb2ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.160716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.162551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442b0b-7cf0-4be2-9aef-6f82b8345cbd None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.178433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd971e83-7341-4ab0-9da0-06ebe2be4b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.179111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971e83-7341-4ab0-9da0-06ebe2be4b36 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.179395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971e83-7341-4ab0-9da0-06ebe2be4b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.179672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971e83-7341-4ab0-9da0-06ebe2be4b36 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.180392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd971e83-7341-4ab0-9da0-06ebe2be4b36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.181842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd971e83-7341-4ab0-9da0-06ebe2be4b36 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.198282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.199157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.199527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.199894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.211783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.213164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:26.234197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:26.238691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:26.239589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:26.239589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:26.239589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:26.239589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:26.239589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 238/464] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:26.239589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.265455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 227/465] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:56:26 2022] POST /identity/v3/users => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:56:26.266517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd971e83-7341-4ab0-9da0-06ebe2be4b36 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.293378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.409274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd971e83-7341-4ab0-9da0-06ebe2be4b36 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.411120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bdab-88d8-4808-ba5c-263fbce6a915 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.452113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ec0ba-7e2b-4a0d-89b1-70788f0f2103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.453853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ec0ba-7e2b-4a0d-89b1-70788f0f2103 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.454379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ec0ba-7e2b-4a0d-89b1-70788f0f2103 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.454861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ec0ba-7e2b-4a0d-89b1-70788f0f2103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.461881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368ac81-3f4b-4191-9861-f3fb93a922a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.462508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368ac81-3f4b-4191-9861-f3fb93a922a9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.462961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368ac81-3f4b-4191-9861-f3fb93a922a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.463385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368ac81-3f4b-4191-9861-f3fb93a922a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.464382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368ac81-3f4b-4191-9861-f3fb93a922a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:26.465516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368ac81-3f4b-4191-9861-f3fb93a922a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.467148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368ac81-3f4b-4191-9861-f3fb93a922a9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.469858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ec0ba-7e2b-4a0d-89b1-70788f0f2103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.471632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ec0ba-7e2b-4a0d-89b1-70788f0f2103 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.489009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 228/466] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:26.490755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de1929-7e4d-4162-93a6-67d4aa17c6d5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.491052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de1929-7e4d-4162-93a6-67d4aa17c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.491339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de1929-7e4d-4162-93a6-67d4aa17c6d5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-ed8ec0ba-7e2b-4a0d-89b1-70788f0f2103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:26.492649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:26.493483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:26.494408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:26.494408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:26.494408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:26.494408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:26.494617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 229/467] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:26.494617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de1929-7e4d-4162-93a6-67d4aa17c6d5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.496506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 239/468] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:26.503804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12bb3-6aca-4d79-b18b-046f016c515f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.504450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12bb3-6aca-4d79-b18b-046f016c515f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.504936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12bb3-6aca-4d79-b18b-046f016c515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.526996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4dd12bb3-6aca-4d79-b18b-046f016c515f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:26.528307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4dd12bb3-6aca-4d79-b18b-046f016c515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:26.541881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.620214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 240/469] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:26.621392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd12bb3-6aca-4d79-b18b-046f016c515f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.628217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de1929-7e4d-4162-93a6-67d4aa17c6d5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.644026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.668225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468e54-5a0e-4153-b4a4-4d612e4ecf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.669191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468e54-5a0e-4153-b4a4-4d612e4ecf64 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.669648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468e54-5a0e-4153-b4a4-4d612e4ecf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.670129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468e54-5a0e-4153-b4a4-4d612e4ecf64 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.671090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3468e54-5a0e-4153-b4a4-4d612e4ecf64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.672800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3468e54-5a0e-4153-b4a4-4d612e4ecf64 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.734116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd12bb3-6aca-4d79-b18b-046f016c515f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.751451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 230/470] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:56:26 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:56:26.759170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468e54-5a0e-4153-b4a4-4d612e4ecf64 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.787582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.788278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.789355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.789639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.790643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:26.790956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.792412 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.819436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 241/471] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:26.833636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:26.900176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.911637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468e54-5a0e-4153-b4a4-4d612e4ecf64 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.931865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:26.954678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b4e46-8edb-4ace-9fb3-badb70c57af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.955839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4e46-8edb-4ace-9fb3-badb70c57af8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.956216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa164-7eb6-4822-97b1-f9a887babdad None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:26.956475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4e46-8edb-4ace-9fb3-badb70c57af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.956891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4e46-8edb-4ace-9fb3-badb70c57af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.968892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b4e46-8edb-4ace-9fb3-badb70c57af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.970949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b4e46-8edb-4ace-9fb3-badb70c57af8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-cf5b4e46-8edb-4ace-9fb3-badb70c57af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:26.993406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:26.994446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:26.995519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:26.995519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:26.995519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:26.995519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:26.995782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a3b20-7e09-4784-8464-c83f5c74146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:26.995782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3b20-7e09-4784-8464-c83f5c74146e None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:26.996052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3b20-7e09-4784-8464-c83f5c74146e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:26.996331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3b20-7e09-4784-8464-c83f5c74146e None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:26.997038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a3b20-7e09-4784-8464-c83f5c74146e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:26.998046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 231/472] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:26.998882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a3b20-7e09-4784-8464-c83f5c74146e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:26.999623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d39d1-1407-4aa1-a60c-f612f3192397 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:27.000051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d39d1-1407-4aa1-a60c-f612f3192397 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:27.000467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d39d1-1407-4aa1-a60c-f612f3192397 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:27.002211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 232/473] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:27.008412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38ec0-2cd7-43b2-a32f-b2c8868dc5c5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:27.008699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38ec0-2cd7-43b2-a32f-b2c8868dc5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:27.008978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b38ec0-2cd7-43b2-a32f-b2c8868dc5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:27.026015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a2b38ec0-2cd7-43b2-a32f-b2c8868dc5c5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:27.027132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a2b38ec0-2cd7-43b2-a32f-b2c8868dc5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:27.098106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 233/474] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:27.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38ec0-2cd7-43b2-a32f-b2c8868dc5c5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:27.116843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 242/475] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:56:26 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:56:27.136982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a3b20-7e09-4784-8464-c83f5c74146e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:27.220668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b38ec0-2cd7-43b2-a32f-b2c8868dc5c5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:27.234372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:27.274594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a3b20-7e09-4784-8464-c83f5c74146e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:27.298957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:27.299664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:27.299954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:27.300233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:27.300979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:27.301289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:27.303390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:27.316036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:27.316719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:27.317004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:27.317283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:27.318886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:27.320311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:27.323014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:27.329841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 234/476] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:27.335540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:27.353588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.sql.core [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 30 11:56:27.353588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 30 11:56:27.353588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [parameters: {'id': '46c2f0793b6f4982ae097abf87dcf961', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 30 11:56:27.353588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80343) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application conn.query(q) May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result.read() May 30 11:56:27.372720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return ref.to_dict() May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:56:27.376513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application next(self.gen) May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application yield resource May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application next(self.gen) May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.session.rollback() May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.force_reraise() May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise self.value May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application session.commit() May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 30 11:56:27.377450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._prepare_impl() May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.session.flush() May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._flush(objects) May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application compat.raise_( May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application flush_context.execute() May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rec.execute(self) May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 30 11:56:27.378984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application _emit_insert_statements( May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application c = connection._execute_20( May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ret = self._execute_context( May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:56:27.380103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application conn.query(q) May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result.read() May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:56:27.380914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [parameters: {'id': '46c2f0793b6f4982ae097abf87dcf961', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:27.381694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 30 11:56:27.384015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:27.388659 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 243/477] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 30 11:56:27 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:27.388659 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:27.487325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cc958-b656-4f3f-8b99-dc135696f473 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:27.510804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e46fef-3a3f-4ee4-a24c-e8c55e07327c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:27.522969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:27.528751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546be51-050c-440b-be9d-87fade148cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:27.529784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546be51-050c-440b-be9d-87fade148cc5 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:27.530490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546be51-050c-440b-be9d-87fade148cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:27.530943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546be51-050c-440b-be9d-87fade148cc5 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:27.531805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546be51-050c-440b-be9d-87fade148cc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:27.537089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546be51-050c-440b-be9d-87fade148cc5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:27.550655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ac80-ae24-49c1-a43a-4af0104163b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:27.550951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ac80-ae24-49c1-a43a-4af0104163b5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:27.551185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ac80-ae24-49c1-a43a-4af0104163b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:27.551462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ac80-ae24-49c1-a43a-4af0104163b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:27.567429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3ac80-ae24-49c1-a43a-4af0104163b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-82c3ac80-ae24-49c1-a43a-4af0104163b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:27.575916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:27.576940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:27.577828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 244/478] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:56:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:27.582854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ac80-ae24-49c1-a43a-4af0104163b5 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:27.615676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 235/479] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:56:27 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:56:27.656308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:27.707269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ac80-ae24-49c1-a43a-4af0104163b5 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:27.746384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e5bfe-92ee-4c17-a9f2-e6503fe1dc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:27.747065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e5bfe-92ee-4c17-a9f2-e6503fe1dc09 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:27.747359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e5bfe-92ee-4c17-a9f2-e6503fe1dc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:27.747640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e5bfe-92ee-4c17-a9f2-e6503fe1dc09 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:27.748403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e5bfe-92ee-4c17-a9f2-e6503fe1dc09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:27.748714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e5bfe-92ee-4c17-a9f2-e6503fe1dc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:27.750202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e5bfe-92ee-4c17-a9f2-e6503fe1dc09 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:27.760261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 245/480] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:29.252208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab207-b7ed-4aac-b239-d6029ea7d96e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.252703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab207-b7ed-4aac-b239-d6029ea7d96e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.252779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab207-b7ed-4aac-b239-d6029ea7d96e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.254449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 236/481] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:29.259648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a720730-e062-43bc-bace-b870ca89359c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.260040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a720730-e062-43bc-bace-b870ca89359c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.260226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a720730-e062-43bc-bace-b870ca89359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.282971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2a720730-e062-43bc-bace-b870ca89359c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:29.284175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2a720730-e062-43bc-bace-b870ca89359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:29.376639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 246/482] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:29.399345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab207-b7ed-4aac-b239-d6029ea7d96e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:29.410504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2586a1-0453-42d3-9459-7f2b3dc0c17a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.410796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2586a1-0453-42d3-9459-7f2b3dc0c17a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.411626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2586a1-0453-42d3-9459-7f2b3dc0c17a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.414256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 247/483] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:29.418105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717226-e6a3-4426-b65e-5be86c215ce5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.418395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717226-e6a3-4426-b65e-5be86c215ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.418677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07717226-e6a3-4426-b65e-5be86c215ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.448619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-07717226-e6a3-4426-b65e-5be86c215ce5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:29.449809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-07717226-e6a3-4426-b65e-5be86c215ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:29.555909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab207-b7ed-4aac-b239-d6029ea7d96e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:29.556561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:29.581542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 248/484] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:29.618584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59099c-8bcf-4155-b6be-662d65f8234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:29.619704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59099c-8bcf-4155-b6be-662d65f8234d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.620168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59099c-8bcf-4155-b6be-662d65f8234d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.620619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59099c-8bcf-4155-b6be-662d65f8234d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.634899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59099c-8bcf-4155-b6be-662d65f8234d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8a59099c-8bcf-4155-b6be-662d65f8234d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:29.643009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:29.643879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:29.644790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:29.647716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 237/485] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:29.653314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07717226-e6a3-4426-b65e-5be86c215ce5 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:29.657234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59099c-8bcf-4155-b6be-662d65f8234d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:29.730321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:29.792213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59099c-8bcf-4155-b6be-662d65f8234d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:29.862491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07717226-e6a3-4426-b65e-5be86c215ce5 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:29.878366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:29.879116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:29.879407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:29.879687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:29.880513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:29.880823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:29.890553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:29.909879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 238/486] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:29.915909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.041648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe693b4-890a-4c5a-ba95-67cc5223b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.042729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe693b4-890a-4c5a-ba95-67cc5223b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.043163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe693b4-890a-4c5a-ba95-67cc5223b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.043609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe693b4-890a-4c5a-ba95-67cc5223b4f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.058571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe693b4-890a-4c5a-ba95-67cc5223b4f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-bfe693b4-890a-4c5a-ba95-67cc5223b4f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:30.072274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:30.073410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:30.074443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:30.081115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 249/487] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:30.085262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef38a9-b529-4ba1-86bc-8a841b5a972a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.085710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef38a9-b529-4ba1-86bc-8a841b5a972a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.086161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef38a9-b529-4ba1-86bc-8a841b5a972a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.087929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 250/488] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:30.088928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef38a9-b529-4ba1-86bc-8a841b5a972a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.110402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedf6c5-7d37-4727-b543-8623a05504cd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.123038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.143236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.157540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05864c1-1892-4d9c-b566-7c2b843aab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.159063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05864c1-1892-4d9c-b566-7c2b843aab1b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.159437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05864c1-1892-4d9c-b566-7c2b843aab1b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.159721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05864c1-1892-4d9c-b566-7c2b843aab1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.173491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05864c1-1892-4d9c-b566-7c2b843aab1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.175827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05864c1-1892-4d9c-b566-7c2b843aab1b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c05864c1-1892-4d9c-b566-7c2b843aab1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:30.203823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:30.204745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:30.205575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:30.205575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:30.205575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:30.205575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:30.205575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 239/489] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:30.207193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830753-0e8d-4efa-b110-ffc93e1dede5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.207493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830753-0e8d-4efa-b110-ffc93e1dede5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.207779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830753-0e8d-4efa-b110-ffc93e1dede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.219626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef38a9-b529-4ba1-86bc-8a841b5a972a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.231439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-81830753-0e8d-4efa-b110-ffc93e1dede5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:30.233385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-81830753-0e8d-4efa-b110-ffc93e1dede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:30.262304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.263655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.264173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.264790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.265812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:30.266316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.267866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.277857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 251/490] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:30.278955 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.311345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 240/491] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:30.312225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81830753-0e8d-4efa-b110-ffc93e1dede5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.389506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc7c6a-df73-49f8-8936-97fb03dc0319 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.391682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.415242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.426194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81830753-0e8d-4efa-b110-ffc93e1dede5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.432238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.432918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.433267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.433553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.434597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:30.435323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.437460 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.458040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 252/492] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:30.460210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.477672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.478795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.479089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.479371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.492793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.494288 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:30.514244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:30.515133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:30.521260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:30.521260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:30.521260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:30.521260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:30.521260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 241/493] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:30.521260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.574736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59290816-9d8e-4e8a-98c7-9ccb893fdd18 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.610406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed55a3-2a9f-43d0-b760-33c22ddcef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.611200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed55a3-2a9f-43d0-b760-33c22ddcef4d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.611490 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed55a3-2a9f-43d0-b760-33c22ddcef4d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.611863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed55a3-2a9f-43d0-b760-33c22ddcef4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.623735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed55a3-2a9f-43d0-b760-33c22ddcef4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:30.624258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c36051-e024-4a51-8525-f4fcfd4af774 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-e1ed55a3-2a9f-43d0-b760-33c22ddcef4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:30.632214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:30.633119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 253/494] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:30.634822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b0e10-f978-464d-8c7a-ba485460fbab None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.635541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b0e10-f978-464d-8c7a-ba485460fbab None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.635541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b0e10-f978-464d-8c7a-ba485460fbab None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.636831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 254/495] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:30.638871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b0e10-f978-464d-8c7a-ba485460fbab None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.669266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.669266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.669266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.669266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.671153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.674566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.676027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:30.693292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:30.694495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:30.695603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:30.697790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 242/496] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:30.702904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.706485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.757562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b0e10-f978-464d-8c7a-ba485460fbab None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.791007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519fdc0-f975-40ab-ae09-60f354d48978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.791666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519fdc0-f975-40ab-ae09-60f354d48978 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.791954 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519fdc0-f975-40ab-ae09-60f354d48978 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.792231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519fdc0-f975-40ab-ae09-60f354d48978 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.792953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519fdc0-f975-40ab-ae09-60f354d48978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:30.793258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519fdc0-f975-40ab-ae09-60f354d48978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.794668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519fdc0-f975-40ab-ae09-60f354d48978 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.806380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 255/497] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:30.807449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47f07-d929-435e-81b4-4a129dec5585 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.807740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47f07-d929-435e-81b4-4a129dec5585 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.808021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47f07-d929-435e-81b4-4a129dec5585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.812055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4bc6e-582a-476a-8754-98b1c2f466aa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.826135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b8f47f07-d929-435e-81b4-4a129dec5585 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:30.827318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b8f47f07-d929-435e-81b4-4a129dec5585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:30.846982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.847649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.847939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.848218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.849452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:30.849762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.851167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:30.858926 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 243/498] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:30.859723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.894036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 256/499] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:30.895356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d60342-4693-4435-a624-79b0791747d6 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.895647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d60342-4693-4435-a624-79b0791747d6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.895928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d60342-4693-4435-a624-79b0791747d6 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.897355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 257/500] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:30.897897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d60342-4693-4435-a624-79b0791747d6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:30.924106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.925076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:30.959571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00a117-53a1-48bf-9804-c0367d31f726 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:30.992152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:30.992910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:30.993203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:30.993486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:30.994361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:30.994679 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:30.996124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.011144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d60342-4693-4435-a624-79b0791747d6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.031956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 244/501] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:31.032773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.044828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f15a00-c798-4dab-8b6c-fff476c84f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.045622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15a00-c798-4dab-8b6c-fff476c84f55 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.045907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15a00-c798-4dab-8b6c-fff476c84f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.046213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15a00-c798-4dab-8b6c-fff476c84f55 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.053200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f15a00-c798-4dab-8b6c-fff476c84f55 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.054661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f15a00-c798-4dab-8b6c-fff476c84f55 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-d0f15a00-c798-4dab-8b6c-fff476c84f55 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:31.070560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:31.071928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:31.072846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 258/502] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:31.073521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6c36c-1b7e-495a-8bd1-3e97aee14e9f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.073731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6c36c-1b7e-495a-8bd1-3e97aee14e9f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.074033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6c36c-1b7e-495a-8bd1-3e97aee14e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.090864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-aea6c36c-1b7e-495a-8bd1-3e97aee14e9f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:31.092034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-aea6c36c-1b7e-495a-8bd1-3e97aee14e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:31.137983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db529867-21f5-4cff-bed7-272314c2a8e3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.157693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 259/503] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:31.158584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6c36c-1b7e-495a-8bd1-3e97aee14e9f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.160948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.162331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.171739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.172533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.172883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.173437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.184573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.186026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:31.203732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:31.204752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:31.205792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:31.205792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:31.205792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:31.205792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:31.209996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 245/504] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:31.210726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.259066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6c36c-1b7e-495a-8bd1-3e97aee14e9f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.291404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.292197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.292484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.292763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.303025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.304477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.307774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c59d7a-d9d1-42c3-a3a5-f4417e05e658 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:31.322351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:31.323167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:31.323994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:31.323994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:31.323994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:31.323994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:31.323994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 260/505] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:31.324258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.341984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84659c-a36e-4015-a33d-2a87b0dda071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.342638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84659c-a36e-4015-a33d-2a87b0dda071 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.342927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84659c-a36e-4015-a33d-2a87b0dda071 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.343206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84659c-a36e-4015-a33d-2a87b0dda071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.381249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.387600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.409042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84659c-a36e-4015-a33d-2a87b0dda071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.410526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84659c-a36e-4015-a33d-2a87b0dda071 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.422898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d778-3cab-4a8f-96c5-02dee9fe1434 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.457359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.457992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.458271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.458547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.459375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:31.459707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.461132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.497445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 261/506] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:31.498279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.513711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 246/507] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:31.513711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84659c-a36e-4015-a33d-2a87b0dda071 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.584250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.601328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c68e6-59c0-452a-aceb-b8b9119b7230 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.606314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84659c-a36e-4015-a33d-2a87b0dda071 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.615171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.636157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c629-c42a-4146-988c-c35fecb9db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.636969 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c629-c42a-4146-988c-c35fecb9db76 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.637257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c629-c42a-4146-988c-c35fecb9db76 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.637636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c629-c42a-4146-988c-c35fecb9db76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.642311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.642968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.643251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.643526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.644242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:31.644544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.646018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.647529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816c629-c42a-4146-988c-c35fecb9db76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-a816c629-c42a-4146-988c-c35fecb9db76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:31.655717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:31.656753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:31.657599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:31.658228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 247/508] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:31.658228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.667466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 262/509] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:31.667466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c629-c42a-4146-988c-c35fecb9db76 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.755690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ea122-2bc1-41d5-9626-dbfe98b9615e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.764668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c629-c42a-4146-988c-c35fecb9db76 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.788834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.789487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.789769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.790076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.790785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:31.791090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.792454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.794705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.797543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71655b-b6c6-4ee8-b4df-240d56a21556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.798226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71655b-b6c6-4ee8-b4df-240d56a21556 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.798561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71655b-b6c6-4ee8-b4df-240d56a21556 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.798840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71655b-b6c6-4ee8-b4df-240d56a21556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.804969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 248/510] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:31.805586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.840564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:31.866523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71655b-b6c6-4ee8-b4df-240d56a21556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.868003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71655b-b6c6-4ee8-b4df-240d56a21556 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.901441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6112c-3f9e-4d0d-b711-012bbd93b116 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:31.933794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:31.934590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:31.934879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:31.935142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:31.944885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:31.946622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:31.964270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:31.965111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:31.970970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:31.970970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:31.970970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:31.970970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:31.971238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 263/511] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:31.971317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 249/512] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:31.971383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71655b-b6c6-4ee8-b4df-240d56a21556 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:31.971447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.018556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:32.034643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:32.062415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71655b-b6c6-4ee8-b4df-240d56a21556 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.067659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e598e-3b49-46ef-bf74-3d2b149672c9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.095970 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.096785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.097244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.097908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.103097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.103755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.104042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.104321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.105068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:32.105374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.105616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.106783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.107085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.114619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 250/513] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:32.115386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:32.121200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:32.122298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 264/514] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:32.123252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.213602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5e3ae-3fbb-4407-820e-273079849a01 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.222055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1a305-6b7b-40d4-9632-24d8b207963a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.224262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:32.246614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ebe6b-0d37-4f80-9078-18041b687963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.247286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ebe6b-0d37-4f80-9078-18041b687963 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.247574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ebe6b-0d37-4f80-9078-18041b687963 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.247855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ebe6b-0d37-4f80-9078-18041b687963 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.248555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ebe6b-0d37-4f80-9078-18041b687963 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.250017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ebe6b-0d37-4f80-9078-18041b687963 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.250186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:32.255329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.256111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.256397 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.256675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.267051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.268486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:32.285834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:32.286871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:32.287777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:32.287777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:32.287777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:32.287777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:32.287777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 265/515] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:32.287777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.337993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 251/516] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:56:32 2022] POST /identity/v3/users => generated 247 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:56:32.337993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ebe6b-0d37-4f80-9078-18041b687963 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.393691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f111-0965-436f-9d25-2d4c3538849c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.430423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.431113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.431402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.431671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.432474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:32.432754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.434188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.444613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ebe6b-0d37-4f80-9078-18041b687963 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.447734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 266/517] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:32.448708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.490855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.491670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.491959 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.492237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.502747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:32.504330 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.505929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:32.524143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:32.532437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:32.533419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:32.533419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:32.533419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:32.533419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:32.533419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 252/518] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:32.533419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.549709 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:32.568903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab2045-20c2-4c5d-937c-dfa6a14bc9cc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.610101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.610860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.611150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.611428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.612265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:32.612574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.614621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.632106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 267/519] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:32.632922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.652432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838dce8-dbe8-4f8b-b2be-281db7c130da None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.689572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.690264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.690550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.691082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.691543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:32.691849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.693254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.711015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 253/520] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:32.711895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.743779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e077fc-f61d-4278-a7da-535376789967 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.748858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:32.783414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.784214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.784708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.784812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.791597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.793048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.802162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:32.808082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:32.809028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 268/521] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:32.816016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.830349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a01f0a-226f-412b-af62-0899678358e6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.867868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.868531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.868814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.869089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.869838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:32.870186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:32.871561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:32.884688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 254/522] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:32.885783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:32.933754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373156-d8b2-438b-9f97-07ba8a9425ff None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:32.970343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5822-6cc8-4c5b-96ba-64112bfb6a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:32.970989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5822-6cc8-4c5b-96ba-64112bfb6a6c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:32.971320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5822-6cc8-4c5b-96ba-64112bfb6a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:32.971607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5822-6cc8-4c5b-96ba-64112bfb6a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:32.988786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f53f1a-9ecc-42a9-9f30-472c90f68b09 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.004439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:33.023234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.024030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.026196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.026196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.031526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.033109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.034978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:33.044249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b5822-6cc8-4c5b-96ba-64112bfb6a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.045906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b5822-6cc8-4c5b-96ba-64112bfb6a6c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:33.049897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:33.050967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:33.052776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:33.052776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:33.052776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:33.052776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:33.052776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:33.052776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:33.052776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:33.052776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:33.054300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 255/523] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:33.055369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.158060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd36066-c0b0-4709-af5e-2ed20d731353 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.161680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 269/524] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:33.162562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5822-6cc8-4c5b-96ba-64112bfb6a6c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.200183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.200872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.201153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.201437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.202285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:33.202601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.204454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.227727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 256/525] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:33.227727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.231827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:33.270655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5822-6cc8-4c5b-96ba-64112bfb6a6c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.292610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:33.305077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.305806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.306134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.306485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.314208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.315642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:33.330977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:33.331881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:33.332807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 270/526] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:33.333359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.340969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eb207-a8dd-4447-9a03-042c2cc319b4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.375755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.376403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.376689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.376964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.377740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:33.378078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.379568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.390958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 257/527] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:33.396908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.437818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21542ce3-00c4-4174-af38-1969f7e790e5 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.462062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:33.474886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.475700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.475987 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.476264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.488359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.491563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.497393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84364-1f9f-4d36-9e8d-0723477e6083 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:33.511065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:33.511973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:33.512808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:33.512808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:33.512808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:33.512808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:33.512808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 271/528] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:33.513085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.522174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:33.540580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.541234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.541519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.541801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.542669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=7ca17dc23a924e41a657db3122445923) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:33.542980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.544420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.558081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 258/529] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/role_assignments?user.id=7ca17dc23a924e41a657db3122445923&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:33.558081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.641593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393a95-1212-4f91-8a43-e46504933d11 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.681280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.682182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.682613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.682968 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.683905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:33.684296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.685879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.690688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab0235-4e77-45f7-9eb3-312afa43ce28 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.706481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 272/530] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:33.707206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.750415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:33.752673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.753310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.753597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.753872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.754786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=ca08d82f02a24e0088aceff2b6ba307d) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:33.757374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.759673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.765266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 259/531] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/role_assignments?user.id=ca08d82f02a24e0088aceff2b6ba307d&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:33.766274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.837659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:33.866224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377ebe-5b02-4e70-8126-9ad5f92aee52 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.902186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.902945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f2f41-348f-475d-a6ed-67a00231d09e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:33.903094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.903449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.903818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:33.904643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:33.905060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:33.907060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:33.919859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 273/532] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:33.925155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:33.943847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48549749-5ae8-4000-ba95-abcbe14f048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:33.944756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549749-5ae8-4000-ba95-abcbe14f048e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:33.945219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549749-5ae8-4000-ba95-abcbe14f048e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:33.945896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549749-5ae8-4000-ba95-abcbe14f048e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.031380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48549749-5ae8-4000-ba95-abcbe14f048e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.033116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48549749-5ae8-4000-ba95-abcbe14f048e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.048443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.072427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c53a0-627a-446f-ba2c-7a6e28e3a37b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.108478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.120710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.121514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.121800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.122103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.130595 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.132128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:34.155224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:34.168859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:34.169711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 274/533] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:34.173991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.174110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 260/534] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:34.178400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48549749-5ae8-4000-ba95-abcbe14f048e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.313410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48549749-5ae8-4000-ba95-abcbe14f048e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.328802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558877-e1c8-458f-8474-fd8a44480c6a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.365891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.366759 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.367030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.367398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.368054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.368792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.369086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.369366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.370218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:34.370537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.372027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.391233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.392298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 275/535] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:34.392797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.398904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.404515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.414649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:34.420626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:34.422711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:34.424758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:34.424758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:34.424758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:34.424758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:34.429687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 261/536] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:34.430612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.519597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf68d3-c699-4a60-9fd8-a8342c9e29fb None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.557729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d20f3-437c-4dbf-91a6-b7918106db6b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.597031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.597698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.597993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.598322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.599054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:34.599359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.600740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.616571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 262/537] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:34.621364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded667f-4287-4e2d-84fb-cc232afbf9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.623293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded667f-4287-4e2d-84fb-cc232afbf9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.623293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded667f-4287-4e2d-84fb-cc232afbf9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.623293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded667f-4287-4e2d-84fb-cc232afbf9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.623774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.623924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded667f-4287-4e2d-84fb-cc232afbf9e9 None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=a4d11748f14d40628414db49de696fd4) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:34.623924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded667f-4287-4e2d-84fb-cc232afbf9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.625207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded667f-4287-4e2d-84fb-cc232afbf9e9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.639554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 276/538] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/role_assignments?user.id=a4d11748f14d40628414db49de696fd4&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:34.688165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.715874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87769c3f-5275-469f-8608-37776d05cc93 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.716523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87769c3f-5275-469f-8608-37776d05cc93 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.717010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87769c3f-5275-469f-8608-37776d05cc93 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.718766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 277/539] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:34.724442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfbdfa-513d-48db-b031-941cce1e5bc5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.724988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfbdfa-513d-48db-b031-941cce1e5bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.725460 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfbdfa-513d-48db-b031-941cce1e5bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.753233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-71dfbdfa-513d-48db-b031-941cce1e5bc5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:34.755040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-71dfbdfa-513d-48db-b031-941cce1e5bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:34.794193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5bfde-8cf7-4c45-96e2-f5512344b137 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:34.871523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:34.872691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:34.874067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:34.874805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:34.890557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:34.892832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:34.894362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 278/540] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:34.918397 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfbdfa-513d-48db-b031-941cce1e5bc5 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:34.924189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:34.925037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:34.925868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:34.925868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:34.925868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:34.925868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:34.925868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:34.925868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:34.925868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:34.925868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:34.928871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 263/541] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:34.933666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:34.934811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.097208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfbdfa-513d-48db-b031-941cce1e5bc5 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.138255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e99f2-f81e-4c91-bc1d-eca1222cab1e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.160575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fe343-df76-4b9e-9e16-0e5a73e5fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.161930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fe343-df76-4b9e-9e16-0e5a73e5fb1d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.162238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fe343-df76-4b9e-9e16-0e5a73e5fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.162516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fe343-df76-4b9e-9e16-0e5a73e5fb1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.176246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.184390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fe343-df76-4b9e-9e16-0e5a73e5fb1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-f28fe343-df76-4b9e-9e16-0e5a73e5fb1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:35.192251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:35.193142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:35.193928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:35.209251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 279/542] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:35.211994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fe343-df76-4b9e-9e16-0e5a73e5fb1d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.214219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.214890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.215177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.215450 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.216245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:35.216555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.218019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.245245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 264/543] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:35.249746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.303976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.373830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fe343-df76-4b9e-9e16-0e5a73e5fb1d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.429482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.430101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.430393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.430673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.431430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:35.431740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.433130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.457007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 280/544] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:35.458477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.485672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fcf9c-2958-440e-8d32-06b954de6caa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.574861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.575622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.575822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.576106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.576962 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=35763651d4614bf68400b5efce4113a1) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:35.577275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.578773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.588941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 265/545] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/role_assignments?user.id=35763651d4614bf68400b5efce4113a1&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:35.601218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365330f-84d2-4507-8a03-796b7b4a6dd5 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.631849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.651907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.652742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.653036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.653308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.665594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.667191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:35.698749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:35.700790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:35.702904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:35.702904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:35.702904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:35.702904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:35.702904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 281/546] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:35.709243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:35.774424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:35.869486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f2310-e54d-4308-9204-2cc38676661a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:35.918844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:35.919616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:35.919861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:35.920168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:35.920889 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:35.921192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:35.922663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:35.944921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 266/547] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:35.951337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:36.069259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bdce3-e809-48be-adfd-cbeb2b4b7b09 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:36.109457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:36.110294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.110581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.110859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.119610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:36.121080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:36.140982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:36.149553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:36.150709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 282/548] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:36.151399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:36.280263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3100d-0024-481e-8b75-e62ce7ddf4f8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:36.281996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:36.329993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9318a41-9676-4466-be42-da3c26faaa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:36.330892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318a41-9676-4466-be42-da3c26faaa4e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.331524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318a41-9676-4466-be42-da3c26faaa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.331810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318a41-9676-4466-be42-da3c26faaa4e None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.332714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9318a41-9676-4466-be42-da3c26faaa4e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:36.333032 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9318a41-9676-4466-be42-da3c26faaa4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:36.334539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9318a41-9676-4466-be42-da3c26faaa4e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:36.357195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 267/549] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 30 11:56:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:36.362683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:36.374591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1251a02-976d-4702-ac29-9cf855a938f4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.374873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1251a02-976d-4702-ac29-9cf855a938f4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.375162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1251a02-976d-4702-ac29-9cf855a938f4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.380722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 268/550] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:36.381927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36accc-0782-465c-80b2-745bfddf7b1c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.382242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36accc-0782-465c-80b2-745bfddf7b1c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.382526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36accc-0782-465c-80b2-745bfddf7b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.411656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cc36accc-0782-465c-80b2-745bfddf7b1c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:36.417200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cc36accc-0782-465c-80b2-745bfddf7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:36.420010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:36.485399 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697eac-25c4-4222-a53a-a07293d3c789 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:36.519648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 269/551] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:36.528485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc12aa-5aea-4897-823e-0a9bd13d10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:36.529341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc12aa-5aea-4897-823e-0a9bd13d10bb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.529776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc12aa-5aea-4897-823e-0a9bd13d10bb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.530226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc12aa-5aea-4897-823e-0a9bd13d10bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.543335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36accc-0782-465c-80b2-745bfddf7b1c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:36.659858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc12aa-5aea-4897-823e-0a9bd13d10bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:36.662079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc12aa-5aea-4897-823e-0a9bd13d10bb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:36.690468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:36.706756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36accc-0782-465c-80b2-745bfddf7b1c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:36.736365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:36.767393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f82c6-337c-4b73-8ff6-2564af2c28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:36.768488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f82c6-337c-4b73-8ff6-2564af2c28a9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.768919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f82c6-337c-4b73-8ff6-2564af2c28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.769407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f82c6-337c-4b73-8ff6-2564af2c28a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.781707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f82c6-337c-4b73-8ff6-2564af2c28a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4e9f82c6-337c-4b73-8ff6-2564af2c28a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:36.790822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:36.791729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:36.792597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:36.795552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 270/552] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:36.802046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757051-a062-438f-921d-a134c981a425 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.802799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757051-a062-438f-921d-a134c981a425 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.803287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757051-a062-438f-921d-a134c981a425 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.805199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 271/553] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:36.806538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b757051-a062-438f-921d-a134c981a425 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:36.821782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 283/554] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:36.823208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f055b-473a-44e2-b496-c6218124864d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:36.823644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f055b-473a-44e2-b496-c6218124864d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:36.824042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f055b-473a-44e2-b496-c6218124864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:36.845253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-897f055b-473a-44e2-b496-c6218124864d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:36.846691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-897f055b-473a-44e2-b496-c6218124864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:36.918358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 284/555] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:36.919564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f055b-473a-44e2-b496-c6218124864d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:36.948978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b757051-a062-438f-921d-a134c981a425 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:36.992209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.001576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.002272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.002557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.002831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.004884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:37.004884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.006382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.015663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 272/556] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:37.016710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.032619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f055b-473a-44e2-b496-c6218124864d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.040206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.071291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.072399 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.072878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.073363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.085342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.087347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:37.108973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:37.110148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:37.111019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:37.111019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:37.111019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:37.111019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:37.111019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 285/557] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:37.117035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.148910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d7ea1-4a1d-401f-bc82-c1ce0360e23c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.184478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32984a8b-1c20-43a6-9c25-7ef9bc6ed562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.185325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32984a8b-1c20-43a6-9c25-7ef9bc6ed562 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.185606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32984a8b-1c20-43a6-9c25-7ef9bc6ed562 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.186282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32984a8b-1c20-43a6-9c25-7ef9bc6ed562 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.198578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32984a8b-1c20-43a6-9c25-7ef9bc6ed562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-32984a8b-1c20-43a6-9c25-7ef9bc6ed562 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:37.206516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:37.208123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:37.209004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 273/558] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:37.209685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb588-f43e-48ad-8964-115aa29e612f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.209753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb588-f43e-48ad-8964-115aa29e612f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.210579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb588-f43e-48ad-8964-115aa29e612f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.211459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 274/559] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:37.212010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beb588-f43e-48ad-8964-115aa29e612f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.239535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327dd65-01d5-4090-97ca-eb77e8ff0387 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.265139 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.277740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.279095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.281105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.281105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.287455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.291794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.293360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:37.312542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:37.313447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:37.314790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:37.314790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:37.314790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:37.314790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:37.314790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 286/560] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:37.314790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.323801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beb588-f43e-48ad-8964-115aa29e612f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.357753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c93d8-bce4-4810-9edd-cdc80c3da91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.358456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c93d8-bce4-4810-9edd-cdc80c3da91f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.358740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c93d8-bce4-4810-9edd-cdc80c3da91f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.359016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c93d8-bce4-4810-9edd-cdc80c3da91f None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.359727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c93d8-bce4-4810-9edd-cdc80c3da91f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:37.360030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c93d8-bce4-4810-9edd-cdc80c3da91f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.361398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c93d8-bce4-4810-9edd-cdc80c3da91f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.373321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 275/561] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:37.374527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7cb9d-cfb4-47ae-aae1-aff784667392 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.374806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7cb9d-cfb4-47ae-aae1-aff784667392 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.375081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7cb9d-cfb4-47ae-aae1-aff784667392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.391257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5ac7cb9d-cfb4-47ae-aae1-aff784667392 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:37.392414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5ac7cb9d-cfb4-47ae-aae1-aff784667392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:37.426398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2909fd0-fb7b-4f8d-bcef-1e1ae53ec434 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.459202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 276/562] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:37.460026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7cb9d-cfb4-47ae-aae1-aff784667392 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.475046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.475894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.476327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.476901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.477662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:37.477991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.479487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.493508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 287/563] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:37.494508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.530628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.531989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.572316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7cb9d-cfb4-47ae-aae1-aff784667392 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.599828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c622d9d-4d52-425b-8be1-2d3100ac38cf None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.608203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.608875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.609159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.609439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.610184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:37.610496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.611877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.623848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 277/564] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:37.624511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.639873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.640676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.640963 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.641239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.649205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.650678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:37.665832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:37.667291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:37.668158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 288/565] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:37.668626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.739099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c3b7b-f924-4b17-98ff-01717dd68cb5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.767203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.773000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:37.778891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212d7d-cd45-4764-908c-72b8aa723104 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.779800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b37f4-c58e-4d07-b004-d3d82dcf7991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.780597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b37f4-c58e-4d07-b004-d3d82dcf7991 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.780884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b37f4-c58e-4d07-b004-d3d82dcf7991 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.781160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b37f4-c58e-4d07-b004-d3d82dcf7991 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.791701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b37f4-c58e-4d07-b004-d3d82dcf7991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5f3b37f4-c58e-4d07-b004-d3d82dcf7991 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:37.799512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:37.806269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 278/566] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:37.807319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b37f4-c58e-4d07-b004-d3d82dcf7991 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.821560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.822629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.822910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.823184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.834884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.836327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:37.855170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:37.856052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:37.856944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:37.856944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:37.856944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:37.856944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:37.861001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 289/567] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:37.861684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:37.908264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b37f4-c58e-4d07-b004-d3d82dcf7991 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.948135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:37.948933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:37.949219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:37.949499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:37.956930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:37.958460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:37.973014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:37.974157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:37.979610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:37.980172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c48f33-219b-4f60-bfee-8591ba592f7d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:37.980246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 279/568] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:37.980246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.018299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.018958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.019243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.019531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.020355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:38.020649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.022226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.023883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.034281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 290/569] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:38.039109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.050139 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.093217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe02c9e-972a-4807-a595-484891699ad4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.133228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.133228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.133228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.133228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.133762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:38.133762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.134005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.142170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 280/570] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:38.142971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.152888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1a5bf-c422-4641-b508-64ca2b60e518 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.189575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.190273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.190564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.190848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.191575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:38.192434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.193808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.210851 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 291/571] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:38.210851 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.254418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074a0a-417a-4cbb-934d-3fb48ef9bf03 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.257950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.283878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.290111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.293595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.293595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.293595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.293595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:38.293595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.294118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.311331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 281/572] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:38.312135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.318050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca13b7-63a0-4fd8-b708-955be31230cf None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.351339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.352017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.352307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.352596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.353425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=8eb03f76d840406ebe2365fd092d72f4) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:38.353740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.355222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.360684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 292/573] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/role_assignments?user.id=8eb03f76d840406ebe2365fd092d72f4&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:38.361314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.427504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031870d5-3a7f-497d-9151-03c72b9e6812 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.464887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbaf01-1958-4214-a139-2b41b8d9f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.465705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbaf01-1958-4214-a139-2b41b8d9f904 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.466027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbaf01-1958-4214-a139-2b41b8d9f904 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.466332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbaf01-1958-4214-a139-2b41b8d9f904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.477324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec47584-8e30-44c8-8e38-503e98b24c74 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.477873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbaf01-1958-4214-a139-2b41b8d9f904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.479383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbaf01-1958-4214-a139-2b41b8d9f904 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ecbbaf01-1958-4214-a139-2b41b8d9f904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:38.499640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:38.500858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:38.501774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:38.501774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:38.501774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:38.501774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:38.501774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 282/574] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:38.502297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3dd56-a33f-4e56-90fc-8866ca35edab None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.502588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3dd56-a33f-4e56-90fc-8866ca35edab None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.502870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3dd56-a33f-4e56-90fc-8866ca35edab None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.504532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 283/575] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:38.505106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3dd56-a33f-4e56-90fc-8866ca35edab None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.517395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.521443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.523932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.524788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.525077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.525348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] PATH_INFO: `/v3/users/glance` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.533760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.536101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:38.553744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:38.559613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 293/576] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:38.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.624260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3dd56-a33f-4e56-90fc-8866ca35edab None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.660123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd6903-4deb-4f50-aab0-6d6f168a9b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.661775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd6903-4deb-4f50-aab0-6d6f168a9b57 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.662241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd6903-4deb-4f50-aab0-6d6f168a9b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.662710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd6903-4deb-4f50-aab0-6d6f168a9b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.668181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024c97-58ac-4075-b0fa-dd0080a448af None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.674607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd6903-4deb-4f50-aab0-6d6f168a9b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.676313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd6903-4deb-4f50-aab0-6d6f168a9b57 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-63cd6903-4deb-4f50-aab0-6d6f168a9b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:38.695811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:38.696886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:38.698015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:38.698015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:38.698015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:38.698015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:38.703187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 284/577] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:38.703187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73ff7-3bef-4379-a09e-58989dbb7e39 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.703187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73ff7-3bef-4379-a09e-58989dbb7e39 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.703187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73ff7-3bef-4379-a09e-58989dbb7e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.709127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.709979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.710371 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.710795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.711632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:38.712040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.713510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.718997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9cc73ff7-3bef-4379-a09e-58989dbb7e39 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:38.720182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9cc73ff7-3bef-4379-a09e-58989dbb7e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:38.731112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 294/578] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:38.731996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.790281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.791693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:38.809980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 285/579] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:38.809980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73ff7-3bef-4379-a09e-58989dbb7e39 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.855053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2678c6-fe03-46a4-a422-9591c7ad5ac5 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.890037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.890715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.891001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.891282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.892126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:38.892441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.893881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.910987 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 295/580] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:38.911796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:38.922705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73ff7-3bef-4379-a09e-58989dbb7e39 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:38.958340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:38.959333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:38.959640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:38.959929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:38.960660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:38.960974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:38.962737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:38.976936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 286/581] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:38.976936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.027239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbdf90-b435-4e12-9f69-a54acf2afe5d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.038881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.040542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.063057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.063849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.064135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.064417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.071808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.073787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.085500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e21a88-c28b-4e35-9622-17b589c532dd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:39.089079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.090154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:56:39.091073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:39.094307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 296/582] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.095768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.122393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a718f2-13ac-49e9-b495-0a97df8bf20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.123722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a718f2-13ac-49e9-b495-0a97df8bf20f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.124205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a718f2-13ac-49e9-b495-0a97df8bf20f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.124694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a718f2-13ac-49e9-b495-0a97df8bf20f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.135971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a718f2-13ac-49e9-b495-0a97df8bf20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e8a718f2-13ac-49e9-b495-0a97df8bf20f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:39.144731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.145851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:39.146905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:39.150473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 287/583] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.151350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a718f2-13ac-49e9-b495-0a97df8bf20f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.202314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411287-ed90-4fcb-becc-2aa37284d865 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.237432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.238178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.238471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.239294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.249934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.251429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.258583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a718f2-13ac-49e9-b495-0a97df8bf20f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:39.268600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.269633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.270747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:39.270747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:39.270747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:39.270747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:39.274280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 297/584] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.275085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.277770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.296456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.299084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.299084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.299084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.299703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.306716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.308160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:39.323060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.324239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:39.325137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 288/585] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.325637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.382340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a52e-223b-46f4-a483-18af71a70649 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.418701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.419669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.419669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.419922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.420818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:39.421125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.422730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.433259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dba0c-0602-43de-9883-898cacfc73b4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.444752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 298/586] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:39.444752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.476668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.477436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.477793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.478173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.478997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:39.479373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.480819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.489915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 289/587] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:39.491180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.531038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.539365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.551185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cefc72-cf18-4bc2-a1f5-d0cebaeedc42 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.587225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.588180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.588658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.589000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.589861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:39.590173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.591647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.602183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40060e-a3c9-40fa-9df5-710b25199179 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.609210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 299/588] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:39.609210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.641451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.642226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.642565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.642908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.643699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:39.644006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.646004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.658735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 290/589] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:39.664684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.711286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c33f-97fa-4048-9cc9-b82628348089 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.752955 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.753909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.754893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.755170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.764298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.766023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:39.768274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.768660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f6ba-fb30-4582-a685-e244df8ee4c2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.769832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:39.787458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.788504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.794206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:39.794206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:39.794206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:39.794206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:39.794206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 300/590] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.794206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.810938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.811743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.812027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.812310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.824028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.825545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:39.843524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.844629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.845744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:39.845744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:39.845744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:39.845744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:39.846435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 291/591] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.847055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.907074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1746c-9213-4257-bbc4-e51f6b19c17a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.941126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.942472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.942768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.943047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:39.950032 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aa956-c1f8-4d4b-b56f-ce4223c0f72f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:39.950250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:39.951662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:39.966619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:39.967516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:39.968436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 301/592] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:39.969643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:39.991404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7799444-b9e0-4a57-be99-35ef46f79a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:39.992299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799444-b9e0-4a57-be99-35ef46f79a05 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:39.992580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799444-b9e0-4a57-be99-35ef46f79a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:39.992851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799444-b9e0-4a57-be99-35ef46f79a05 None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/7ca17dc23a924e41a657db3122445923/roles/aac7e705dfc84393a31372f43cedd793` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.009509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7799444-b9e0-4a57-be99-35ef46f79a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=7ca17dc23a924e41a657db3122445923, role_id=aac7e705dfc84393a31372f43cedd793)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.010927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7799444-b9e0-4a57-be99-35ef46f79a05 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.025077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.071161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202638f-3b5e-45b6-98b1-dab60725c8eb None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.086295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.096678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 292/593] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:56:39 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/7ca17dc23a924e41a657db3122445923/roles/aac7e705dfc84393a31372f43cedd793 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:40.096678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7799444-b9e0-4a57-be99-35ef46f79a05 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.112500 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.117535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.117535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.117535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.117535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:40.117535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.117535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.131853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 302/594] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:40.132739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.221209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7799444-b9e0-4a57-be99-35ef46f79a05 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.268562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.269162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.269445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.270619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.271116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:40.271427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.273046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.280628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4ee8-3232-4971-b9fb-ae7a9680d60f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.288281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 293/595] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:40.289344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.302036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.332013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.333528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.333819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.334155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.334960 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:40.335686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.337615 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.353996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 303/596] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:40.353996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.366845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.412591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149c16f-9811-4f25-ba6e-9dd2574e8d79 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.447883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.448689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.448979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.449261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.459165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.460907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.471287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a5471-8332-4d7f-931d-3b32de918d4d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:40.487694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:40.488661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:40.489611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 294/597] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:40.490133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.514251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.515051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.515336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.515612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.524125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.525683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:40.540774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:40.541836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:56:40.542803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:40.546111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 304/598] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:40.546943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.580287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.622415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e31290-61f9-487f-a5e2-92e9fc552435 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.643154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.656567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b308a3-5bee-4b9b-a16f-85992d597c9b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.658165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ca227-5e01-469b-a0a0-d1ba77628628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.659979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ca227-5e01-469b-a0a0-d1ba77628628 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.660366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ca227-5e01-469b-a0a0-d1ba77628628 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.661161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ca227-5e01-469b-a0a0-d1ba77628628 None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/ca08d82f02a24e0088aceff2b6ba307d/roles/aac7e705dfc84393a31372f43cedd793` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.677988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ca227-5e01-469b-a0a0-d1ba77628628 None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=ca08d82f02a24e0088aceff2b6ba307d, role_id=aac7e705dfc84393a31372f43cedd793)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.679866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ca227-5e01-469b-a0a0-d1ba77628628 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.693010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.693676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.694002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.701598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.701598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:40.701598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.701598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.708795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 305/599] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:40.709488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.760141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 295/600] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:56:40 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/ca08d82f02a24e0088aceff2b6ba307d/roles/aac7e705dfc84393a31372f43cedd793 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:40.760141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31a57-3dcd-4216-ad8a-67d066e87860 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.760141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31a57-3dcd-4216-ad8a-67d066e87860 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.760141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31a57-3dcd-4216-ad8a-67d066e87860 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.760141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 296/601] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:40.761028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31a57-3dcd-4216-ad8a-67d066e87860 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:40.820001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:40.829616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946372e-1a96-48ae-b058-c43a4b6e2ede None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.868644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f121c-b362-4141-9dd4-397ecd3dc447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.869331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f121c-b362-4141-9dd4-397ecd3dc447 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.869622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f121c-b362-4141-9dd4-397ecd3dc447 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.869978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f121c-b362-4141-9dd4-397ecd3dc447 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.870918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f121c-b362-4141-9dd4-397ecd3dc447 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:40.871233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f121c-b362-4141-9dd4-397ecd3dc447 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.872777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f121c-b362-4141-9dd4-397ecd3dc447 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.897605 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 306/602] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:40.898796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424c6a7-d406-4f8f-b913-03d82e8fff94 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.899088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424c6a7-d406-4f8f-b913-03d82e8fff94 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.899355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424c6a7-d406-4f8f-b913-03d82e8fff94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.918147 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-6424c6a7-d406-4f8f-b913-03d82e8fff94 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:40.918672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31a57-3dcd-4216-ad8a-67d066e87860 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:40.919472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6424c6a7-d406-4f8f-b913-03d82e8fff94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:40.970087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f141684-6174-4656-89dc-c8f33d65b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:40.972081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141684-6174-4656-89dc-c8f33d65b48c None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:40.972597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141684-6174-4656-89dc-c8f33d65b48c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:40.973649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141684-6174-4656-89dc-c8f33d65b48c None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/a4d11748f14d40628414db49de696fd4/roles/aac7e705dfc84393a31372f43cedd793` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:40.993589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f141684-6174-4656-89dc-c8f33d65b48c None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=a4d11748f14d40628414db49de696fd4, role_id=aac7e705dfc84393a31372f43cedd793)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:40.995609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f141684-6174-4656-89dc-c8f33d65b48c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:40.997875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 307/603] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:41.001629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424c6a7-d406-4f8f-b913-03d82e8fff94 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.086141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:41.098794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 297/604] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:56:40 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/a4d11748f14d40628414db49de696fd4/roles/aac7e705dfc84393a31372f43cedd793 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:41.100048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f141684-6174-4656-89dc-c8f33d65b48c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.122878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424c6a7-d406-4f8f-b913-03d82e8fff94 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:41.154337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:41.209042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:41.210101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:41.210482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:41.210825 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:41.234944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:41.237514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:41.268863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:41.270591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:41.271693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:41.271693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:41.271693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:41.271693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:41.282329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 308/605] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:41.286324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.341580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f141684-6174-4656-89dc-c8f33d65b48c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:41.380818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0bfcf-5ae3-46e5-9cd2-c35dadc1b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:41.381688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0bfcf-5ae3-46e5-9cd2-c35dadc1b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:41.382053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0bfcf-5ae3-46e5-9cd2-c35dadc1b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:41.382338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0bfcf-5ae3-46e5-9cd2-c35dadc1b2a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:41.394172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0bfcf-5ae3-46e5-9cd2-c35dadc1b2a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-07a0bfcf-5ae3-46e5-9cd2-c35dadc1b2a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:41.406412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:41.407567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:41.408652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 298/606] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:41.413982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f23bb-530f-4cd0-9d0a-62b332a1af6a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:41.414657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0bfcf-5ae3-46e5-9cd2-c35dadc1b2a4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.447193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:41.453923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:41.455023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:41.455540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:41.456024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:41.456986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:41.458070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:41.460217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:41.473203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 309/607] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:41.478547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.504532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:41.524961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0bfcf-5ae3-46e5-9cd2-c35dadc1b2a4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:41.561280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:41.562066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:41.562456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:41.562807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:41.563625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:41.564002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:41.565465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:41.575269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 299/608] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:41.580914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.615836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d0d8b-40a9-4ff7-93b9-7c4b9549c2db None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:41.657192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:41.658533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:41.659019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:41.659479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:41.668203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:41.669948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:41.686902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:41.687877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:41.688768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:41.688768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:41.688768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:41.688768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:41.688768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:41.688768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:41.688768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:41.688768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:41.691311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 310/609] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:41.711405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.755775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea79e7b-20d5-4f57-b82c-1e33dd12e6c7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:41.818246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:41.842707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:41.843687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:41.844095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:41.844476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:41.872789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83c5e-1ed4-4dd9-8b29-93c0ed86daae None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:41.873287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:41.873287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:41.874964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:41.906667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:41.913922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:41.915001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:41.915001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:41.915001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:41.915001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:41.915001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 300/610] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:41.915001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:41.921353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:41.922950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:41.923239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:41.923523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:41.924321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:41.924633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:41.926657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:41.948682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 311/611] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:41.954048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:42.147489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b8709-7769-4158-bfd0-f89995f15047 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:42.164199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc07e3-4de1-40d0-aa57-7d6ab3b347d4 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:42.202380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:42.208778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bfc1c-a2e3-402c-9cdd-559622fb927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:42.209681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bfc1c-a2e3-402c-9cdd-559622fb927c None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:42.209984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bfc1c-a2e3-402c-9cdd-559622fb927c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:42.210259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bfc1c-a2e3-402c-9cdd-559622fb927c None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/35763651d4614bf68400b5efce4113a1/roles/aac7e705dfc84393a31372f43cedd793` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:42.231287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:42.231955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:42.232237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:42.232510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:42.233234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:42.233537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:42.234943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:42.245456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bfc1c-a2e3-402c-9cdd-559622fb927c None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=35763651d4614bf68400b5efce4113a1, role_id=aac7e705dfc84393a31372f43cedd793)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:42.247679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bfc1c-a2e3-402c-9cdd-559622fb927c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:42.256974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 301/612] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:42.262166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:42.326482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:42.330789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 312/613] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:56:41 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/35763651d4614bf68400b5efce4113a1/roles/aac7e705dfc84393a31372f43cedd793 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:56:42.378817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f16235-3660-49c4-b3e1-6663fafbe2c8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:42.432328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd627c89-cb5a-4926-856b-c54570aa7c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:42.433487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd627c89-cb5a-4926-856b-c54570aa7c6f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:42.434007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd627c89-cb5a-4926-856b-c54570aa7c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:42.434564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd627c89-cb5a-4926-856b-c54570aa7c6f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:42.448696 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd627c89-cb5a-4926-856b-c54570aa7c6f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:42.450668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd627c89-cb5a-4926-856b-c54570aa7c6f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-dd627c89-cb5a-4926-856b-c54570aa7c6f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:42.473908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:42.474952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:56:42.475886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:42.478731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 302/614] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:42.484763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bfc1c-a2e3-402c-9cdd-559622fb927c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:42.591876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bfc1c-a2e3-402c-9cdd-559622fb927c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:42.627280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7608dab-3d59-437d-8627-d12503f135ae None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:42.627869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7608dab-3d59-437d-8627-d12503f135ae None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:42.628148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7608dab-3d59-437d-8627-d12503f135ae None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:42.629703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 303/615] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:42.633764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:42.634477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:42.634764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:42.635042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:42.635897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:42.636159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc696907-6cb7-45e7-bff1-8f419e7d6516 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:42.636264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:42.636735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc696907-6cb7-45e7-bff1-8f419e7d6516 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:42.637210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc696907-6cb7-45e7-bff1-8f419e7d6516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:42.637756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:42.657059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bc696907-6cb7-45e7-bff1-8f419e7d6516 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:42.657480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 313/616] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 30 11:56:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:42.658870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bc696907-6cb7-45e7-bff1-8f419e7d6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:42.663854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:42.690339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:42.763365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 304/617] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:42.805836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc696907-6cb7-45e7-bff1-8f419e7d6516 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:42.859872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:42.864100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c4bf5-acc0-4396-a7d6-74f6f1ee18fb None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:42.920804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc696907-6cb7-45e7-bff1-8f419e7d6516 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:42.959654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bdf90-323d-4cf3-ad83-5b0411dc367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:42.960368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bdf90-323d-4cf3-ad83-5b0411dc367e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:42.960654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bdf90-323d-4cf3-ad83-5b0411dc367e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:42.960934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bdf90-323d-4cf3-ad83-5b0411dc367e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:42.971810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bdf90-323d-4cf3-ad83-5b0411dc367e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:42.974679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:42.975487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:42.975768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:42.976041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-356bdf90-323d-4cf3-ad83-5b0411dc367e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:42.979763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:42.980697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:42.981531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 305/618] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:42.990917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bdf90-323d-4cf3-ad83-5b0411dc367e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:42.996785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:42.998377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:43.025826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:43.028006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:43.030330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:43.030330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:43.030330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:43.030330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:43.036077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 314/619] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:43.042952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.126691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bdf90-323d-4cf3-ad83-5b0411dc367e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:43.138449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:43.173797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:43.175755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.176518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.176712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.177475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:43.177783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:43.179270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:43.188641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 306/620] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:43.194497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.203076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:43.258415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70434887-a399-4bbe-8f79-3719e0247493 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:43.312014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32af2f0-4001-4c31-bcb8-48430a55983e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:43.321738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:43.322441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.322729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.323006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.323735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:43.324037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:43.325416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:43.356541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:43.357344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.357632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.357910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.358628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 315/621] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:43.364724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.374522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:43.376084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:43.402892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:43.405045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:43.407265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:43.407265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:43.407265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:43.407265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:43.407265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 307/622] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:43.413475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.454760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:43.559194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a649cf-cf5f-4853-afd2-73ec79655a8c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:43.582681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc4950-c745-440e-96bb-7acedb23f778 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:43.590831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:43.596007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2fcbc-6b63-4339-8f9f-5017a4c3d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:43.597047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fcbc-6b63-4339-8f9f-5017a4c3d525 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.597560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fcbc-6b63-4339-8f9f-5017a4c3d525 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.598637 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fcbc-6b63-4339-8f9f-5017a4c3d525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.605722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2fcbc-6b63-4339-8f9f-5017a4c3d525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:43.607579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2fcbc-6b63-4339-8f9f-5017a4c3d525 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-fbb2fcbc-6b63-4339-8f9f-5017a4c3d525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:43.623108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:43.624027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:43.624936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:43.624936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:43.624936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:43.624936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:43.624936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:43.624936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:43.624936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:43.624936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:43.625374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b7684-eb38-4dbc-bcf9-9c2a15bd3bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:43.625374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7684-eb38-4dbc-bcf9-9c2a15bd3bbb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.625540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7684-eb38-4dbc-bcf9-9c2a15bd3bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.626151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7684-eb38-4dbc-bcf9-9c2a15bd3bbb None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.626451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7684-eb38-4dbc-bcf9-9c2a15bd3bbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:43.626755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7684-eb38-4dbc-bcf9-9c2a15bd3bbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:43.628138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b7684-eb38-4dbc-bcf9-9c2a15bd3bbb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:43.628540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 316/623] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:43.630098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291847d-00f9-453e-92b4-1e6a7007acc7 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.630591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291847d-00f9-453e-92b4-1e6a7007acc7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.631071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291847d-00f9-453e-92b4-1e6a7007acc7 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.632871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 317/624] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:43.633817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291847d-00f9-453e-92b4-1e6a7007acc7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.649458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 308/625] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:43.649458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18887ee-9e13-4a14-891b-d1a6f54afbdc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.649458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18887ee-9e13-4a14-891b-d1a6f54afbdc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.649458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18887ee-9e13-4a14-891b-d1a6f54afbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.670830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f18887ee-9e13-4a14-891b-d1a6f54afbdc None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:43.672811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f18887ee-9e13-4a14-891b-d1a6f54afbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:43.757728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291847d-00f9-453e-92b4-1e6a7007acc7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:43.769906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 309/626] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:43.771075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18887ee-9e13-4a14-891b-d1a6f54afbdc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.788818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:43.810441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:43.811031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.811512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.811642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.812451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:43.812763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:43.814243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:43.826839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 318/627] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:43.827662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.884897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:43.887261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18887ee-9e13-4a14-891b-d1a6f54afbdc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:43.923807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c1e34-cc18-4bab-9944-ef7e1ba08593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:43.924599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1e34-cc18-4bab-9944-ef7e1ba08593 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.924881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1e34-cc18-4bab-9944-ef7e1ba08593 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.925155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1e34-cc18-4bab-9944-ef7e1ba08593 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.932404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c1e34-cc18-4bab-9944-ef7e1ba08593 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:43.933835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c1e34-cc18-4bab-9944-ef7e1ba08593 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:43.935210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308999-5da6-452a-a9ca-62624f675931 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-db3c1e34-cc18-4bab-9944-ef7e1ba08593 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:43.948533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:43.949481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:43.950532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 310/628] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:56:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:43.951635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838edfe-82ed-4dac-8160-1cb08d84819c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.951635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838edfe-82ed-4dac-8160-1cb08d84819c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.951635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838edfe-82ed-4dac-8160-1cb08d84819c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.957504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 311/629] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:43.957504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838edfe-82ed-4dac-8160-1cb08d84819c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:43.979929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4949-113a-457a-97ae-189ec29ad3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:43.980810 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4949-113a-457a-97ae-189ec29ad3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:43.981103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4949-113a-457a-97ae-189ec29ad3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:43.981387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4949-113a-457a-97ae-189ec29ad3c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:43.991797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4949-113a-457a-97ae-189ec29ad3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-b9dd4949-113a-457a-97ae-189ec29ad3c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:43.999634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:44.000571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:44.001388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 319/630] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:44.002803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4949-113a-457a-97ae-189ec29ad3c2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.030511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.064834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838edfe-82ed-4dac-8160-1cb08d84819c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.101583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d6ed-568f-42bd-aa19-6506f6ba38c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.102795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d6ed-568f-42bd-aa19-6506f6ba38c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.103314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d6ed-568f-42bd-aa19-6506f6ba38c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.103689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d6ed-568f-42bd-aa19-6506f6ba38c6 None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/8eb03f76d840406ebe2365fd092d72f4/roles/aac7e705dfc84393a31372f43cedd793` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.106331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4949-113a-457a-97ae-189ec29ad3c2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.118604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5d6ed-568f-42bd-aa19-6506f6ba38c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=8eb03f76d840406ebe2365fd092d72f4, role_id=aac7e705dfc84393a31372f43cedd793)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.120154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5d6ed-568f-42bd-aa19-6506f6ba38c6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.120807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.141042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86339b9-7ef0-4725-9809-0d155451caeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.141713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86339b9-7ef0-4725-9809-0d155451caeb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.142025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86339b9-7ef0-4725-9809-0d155451caeb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.142310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86339b9-7ef0-4725-9809-0d155451caeb None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.143150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86339b9-7ef0-4725-9809-0d155451caeb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:44.143462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86339b9-7ef0-4725-9809-0d155451caeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.145443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86339b9-7ef0-4725-9809-0d155451caeb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.163257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 320/631] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:44.164476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbe4f6-b06d-4272-8fd3-41c1c6b3cd21 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.164771 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbe4f6-b06d-4272-8fd3-41c1c6b3cd21 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.165053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbe4f6-b06d-4272-8fd3-41c1c6b3cd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.181170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-eedbe4f6-b06d-4272-8fd3-41c1c6b3cd21 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:44.182393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-eedbe4f6-b06d-4272-8fd3-41c1c6b3cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:44.247107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 321/632] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:44.248285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbe4f6-b06d-4272-8fd3-41c1c6b3cd21 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.266002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 312/633] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:56:43 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/8eb03f76d840406ebe2365fd092d72f4/roles/aac7e705dfc84393a31372f43cedd793 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:56:44.268373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d6ed-568f-42bd-aa19-6506f6ba38c6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.387795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.391259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbe4f6-b06d-4272-8fd3-41c1c6b3cd21 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.440743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.442431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.442540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d6ed-568f-42bd-aa19-6506f6ba38c6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.443012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.443482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.444680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:44.446469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.448671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.465467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.466494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 322/634] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:44.467659 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.490265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e49d19-a7a8-4830-832c-49dd772936ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.490989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e49d19-a7a8-4830-832c-49dd772936ce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.491280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e49d19-a7a8-4830-832c-49dd772936ce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.491560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e49d19-a7a8-4830-832c-49dd772936ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.587305 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e49d19-a7a8-4830-832c-49dd772936ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.589036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e49d19-a7a8-4830-832c-49dd772936ce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.609149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20358b-02a0-40c9-9005-a27708793c56 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.646216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67657d73-46d5-44f2-a064-9ed69823f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.647386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657d73-46d5-44f2-a064-9ed69823f07f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.647868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657d73-46d5-44f2-a064-9ed69823f07f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.648355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657d73-46d5-44f2-a064-9ed69823f07f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.660521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67657d73-46d5-44f2-a064-9ed69823f07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-67657d73-46d5-44f2-a064-9ed69823f07f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:44.672350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:44.673313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:44.674181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:44.678596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 323/635] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:44.679680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67657d73-46d5-44f2-a064-9ed69823f07f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.711534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.735607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 313/636] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:44.736545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e49d19-a7a8-4830-832c-49dd772936ce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.760328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:44.819223 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67657d73-46d5-44f2-a064-9ed69823f07f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.856736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.857539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.857829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.858143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.867662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e49d19-a7a8-4830-832c-49dd772936ce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:44.869747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.871240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:44.889357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:44.890386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:44.891304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:44.891304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:44.891304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:44.891304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:44.894292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 324/637] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:44.895228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.909553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:44.910605 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:44.911127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:44.911687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:44.912749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:44.913155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:44.914680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:44.923100 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 314/638] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:44.923814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:44.983303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.007488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.010745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33885f8b-dafc-45e5-9481-9b31b5631801 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.026939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fca72b-0c96-46a3-83a3-d2dd517ac3cb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.047503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.048418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.048703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.048982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.061282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.062788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.063054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75f4e2-0b38-4236-8936-025655fd2578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.063724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f4e2-0b38-4236-8936-025655fd2578 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.064013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f4e2-0b38-4236-8936-025655fd2578 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.064295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75f4e2-0b38-4236-8936-025655fd2578 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.065022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75f4e2-0b38-4236-8936-025655fd2578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:45.065360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75f4e2-0b38-4236-8936-025655fd2578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.066754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75f4e2-0b38-4236-8936-025655fd2578 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.083009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 315/639] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:45.083009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b860cc-42db-44c9-b3b5-bad29e83946a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.083009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b860cc-42db-44c9-b3b5-bad29e83946a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.083009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b860cc-42db-44c9-b3b5-bad29e83946a None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:45.083332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:45.084138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:45.085012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:45.085012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:45.085012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:45.085012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:45.085237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 316/640] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:45.085237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b860cc-42db-44c9-b3b5-bad29e83946a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.090415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 325/641] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:45.090415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.195899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b860cc-42db-44c9-b3b5-bad29e83946a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.198386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44444252-4f58-44e6-8afc-d726e2158a81 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.224765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.231423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.232239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.235970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.235970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.236167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74397a22-a1ad-4a33-a038-d59a529fd170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.236167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397a22-a1ad-4a33-a038-d59a529fd170 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.236167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397a22-a1ad-4a33-a038-d59a529fd170 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.236167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397a22-a1ad-4a33-a038-d59a529fd170 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.241413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.243646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74397a22-a1ad-4a33-a038-d59a529fd170 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.245088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74397a22-a1ad-4a33-a038-d59a529fd170 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.246131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.247549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-74397a22-a1ad-4a33-a038-d59a529fd170 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:45.260002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:45.261034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 30 11:56:45.262010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:45.268603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 326/642] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:45.268603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e718f99-f5c6-4140-8647-f9f09eb56056 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.268603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e718f99-f5c6-4140-8647-f9f09eb56056 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.268603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e718f99-f5c6-4140-8647-f9f09eb56056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:45.268853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:45.270589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:45.272299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:45.272299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:45.272299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:45.272299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:45.272299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 317/643] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:45.272299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.288352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4e718f99-f5c6-4140-8647-f9f09eb56056 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:45.289638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4e718f99-f5c6-4140-8647-f9f09eb56056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:45.361119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 327/644] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:45.362109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e718f99-f5c6-4140-8647-f9f09eb56056 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.386785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b744a-5cc9-4f36-b987-713eb11ae083 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.423328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.424242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.424671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.425087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.426474 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:45.426924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.428476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.440835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 318/645] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:45.442601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.473289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e718f99-f5c6-4140-8647-f9f09eb56056 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.492289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.499895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.511527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.512385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.512834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.513280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.514303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:45.514613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.516062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.537951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 328/646] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:45.537951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.547622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4f34-7c5d-45ed-a6a2-ff0f3e9498d6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.587791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.588468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.588751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.589033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.589764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:45.590108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.591503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.603639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 319/647] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:45.604466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.655536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff0662-a4cd-4f70-ba4d-5b18f2b1c7b2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.691149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734d24-9e19-4816-80ff-dc341869f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.692494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734d24-9e19-4816-80ff-dc341869f789 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.692784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734d24-9e19-4816-80ff-dc341869f789 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.693065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734d24-9e19-4816-80ff-dc341869f789 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.704130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67734d24-9e19-4816-80ff-dc341869f789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:45.705471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4b779-845b-4937-9c0d-1e9764ae632d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-67734d24-9e19-4816-80ff-dc341869f789 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:45.712232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:45.713149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 329/648] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:45.714404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734d24-9e19-4816-80ff-dc341869f789 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.724557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.748760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.749885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.750615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.750870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.758152 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.758728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.760244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:45.774264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:45.775171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:45.776112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 320/649] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:45.776582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.833216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734d24-9e19-4816-80ff-dc341869f789 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.870289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e94dc2-7485-4725-8d62-1b992d0204fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.871219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e94dc2-7485-4725-8d62-1b992d0204fc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.871689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e94dc2-7485-4725-8d62-1b992d0204fc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.872170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e94dc2-7485-4725-8d62-1b992d0204fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.880845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a06897-5ba2-4636-a651-a24e58b8de44 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:45.914326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:45.915116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:45.915400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:45.915675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:45.923106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.924544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:45.938918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:45.939859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 321/650] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:45.940801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:45.948637 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e94dc2-7485-4725-8d62-1b992d0204fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:45.950138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e94dc2-7485-4725-8d62-1b992d0204fc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:45.978343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:45.982545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.049050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b70f2-a8b1-44dc-af19-fa547edf52ea None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.055463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 330/651] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:46.057432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e94dc2-7485-4725-8d62-1b992d0204fc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.084547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.085338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.085697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.086079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.087044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:46.087432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.088819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.102639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 322/652] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:46.102639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.172983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e94dc2-7485-4725-8d62-1b992d0204fc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.201104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.208909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954614f0-6bfd-490c-bf19-1558dd556c45 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.210593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.211721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.211721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.211909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.212573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:46.212880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.214338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.216521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.232655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 331/653] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:46.232655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.245312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.246396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.247024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.247399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.248270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:46.248584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.250183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.276114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 323/654] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:46.277720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.341715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53477a3e-0ac4-491e-8091-b740a3de983a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.382470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.383613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.383942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c6063-5faf-47f4-bebd-7e9bf741b86d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.384341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.384820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.400052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.401517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.419498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:46.419662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:46.420519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:46.421429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:46.421429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:46.421429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:46.421429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:46.421660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.421660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.421785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 332/655] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:46.421852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.426223 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.436654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.438137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:46.455958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:46.457401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:46.458374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:46.458374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:46.458374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:46.458374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:46.458374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 324/656] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:46.459147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.464079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.476334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.533814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefd4a-5a96-4e35-bb1d-a31120c712f0 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.559821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e0f0-3895-4fed-9161-5967ac120c73 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.568885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.569534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.569882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.570381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.571315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=7ca17dc23a924e41a657db3122445923) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:46.571630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.573058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.589988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 333/657] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/role_assignments?user.id=7ca17dc23a924e41a657db3122445923&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:46.589988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.597121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d741d-d09d-4db2-a007-2b10b477ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.598556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d741d-d09d-4db2-a007-2b10b477ab04 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.598851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d741d-d09d-4db2-a007-2b10b477ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.599132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d741d-d09d-4db2-a007-2b10b477ab04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.678302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d741d-d09d-4db2-a007-2b10b477ab04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.679792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d741d-d09d-4db2-a007-2b10b477ab04 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.682757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.703477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a212b-0537-4f86-bc0d-ffb9aea503f6 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.716345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.748630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.749442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.749797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.750184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.751016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:46.751306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.752748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.767215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 334/658] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:46.768076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.803268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 325/659] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:46.804966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cc4a5-437b-47d7-94fd-ddae5f0460f3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.806114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cc4a5-437b-47d7-94fd-ddae5f0460f3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.806114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cc4a5-437b-47d7-94fd-ddae5f0460f3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.807171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 326/660] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:46.807815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cc4a5-437b-47d7-94fd-ddae5f0460f3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.889852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd402f-d850-4b42-b0ee-c5b3059edcf2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.918532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cc4a5-437b-47d7-94fd-ddae5f0460f3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:46.921785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:46.925325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771af57b-5298-4130-aee8-82f8f892a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.926559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af57b-5298-4130-aee8-82f8f892a109 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.926847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af57b-5298-4130-aee8-82f8f892a109 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.927469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771af57b-5298-4130-aee8-82f8f892a109 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.927846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771af57b-5298-4130-aee8-82f8f892a109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:46.928154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771af57b-5298-4130-aee8-82f8f892a109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.929694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771af57b-5298-4130-aee8-82f8f892a109 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.942693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 335/661] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:46.943852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc510d5-b0ad-46bd-b35c-c1063380eaa1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.944143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc510d5-b0ad-46bd-b35c-c1063380eaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.944425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc510d5-b0ad-46bd-b35c-c1063380eaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.958300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:46.959091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:46.959370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:46.959643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:46.962621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9dc510d5-b0ad-46bd-b35c-c1063380eaa1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:46.963831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9dc510d5-b0ad-46bd-b35c-c1063380eaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:46.966584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:46.968026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:46.981722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:46.982819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 327/662] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:46.983870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:46.992810 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:47.038934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 336/663] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:47.040019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc510d5-b0ad-46bd-b35c-c1063380eaa1 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.107052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a4da5-c876-4843-9543-eb0197d4c6e6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.147912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.148795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.149077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.149370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.158124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc510d5-b0ad-46bd-b35c-c1063380eaa1 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.160870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:47.162237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:47.180171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:47.181360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:47.183169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:47.183169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:47.183169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:47.183169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:47.186023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 328/664] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:47.186872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.198920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.200143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.200488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.207686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:47.208196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:47.210000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:47.225598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:47.226623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:47.227552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 337/665] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:47.228155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.250606 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:47.297639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11f99-165c-4fd3-8bac-bf0e19414e7e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.330442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2770-eefa-4b0a-94b2-792231b041de None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.334830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.335568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.335866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.336150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.336947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:47.337261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:47.338777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:47.360295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 329/666] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:47.360295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.369160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6ea41-eaff-45b4-b6fc-a6388a3f95be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.369980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ea41-eaff-45b4-b6fc-a6388a3f95be None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.370363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ea41-eaff-45b4-b6fc-a6388a3f95be None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.370653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ea41-eaff-45b4-b6fc-a6388a3f95be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.381383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6ea41-eaff-45b4-b6fc-a6388a3f95be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-09c6ea41-eaff-45b4-b6fc-a6388a3f95be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:47.389244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:47.390401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:47.391355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 338/667] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:47.392161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6ea41-eaff-45b4-b6fc-a6388a3f95be None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.451913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:47.475788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe90e7b-7282-48eb-96f7-0dc251144f73 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.478588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:47.499107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6ea41-eaff-45b4-b6fc-a6388a3f95be None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.513670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.514644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.514939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.515219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.516104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:47.516699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:47.518112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:47.532606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 330/668] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:47.533382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.537723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.538423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.538707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.538977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.539813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:47.540123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:47.541571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:47.559468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 339/669] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:47.560254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.645931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77469b49-d78c-43da-b6ba-935d2da303d0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.662933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56341764-f10b-4034-b25e-1870e5692809 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.681629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.682313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.682603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.682881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.683717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=ca08d82f02a24e0088aceff2b6ba307d) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:47.684030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:47.685466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:47.688305 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:47.692556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 331/670] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/role_assignments?user.id=ca08d82f02a24e0088aceff2b6ba307d&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:47.693207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.706917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.708011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.708499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.708975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.709986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:47.710597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:47.712330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:47.719116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:47.727653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 340/671] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:47.728947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.837502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6ecb4-6d01-4fe1-a69c-d48eab8e1b4f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.876368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.877184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.877471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.877750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.879677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2bbd8-5a11-4be6-b625-3b999728e509 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:47.886215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:47.887724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:47.903412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:47.904362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:47.905238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:47.905238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:47.905238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:47.905238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:47.905238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:47.905238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:47.905238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:47.905238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:47.909315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 332/672] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:47.910331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:47.931545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1a825-20c0-496e-ad5e-00400951e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:47.932207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1a825-20c0-496e-ad5e-00400951e640 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:47.932611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1a825-20c0-496e-ad5e-00400951e640 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:47.932893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1a825-20c0-496e-ad5e-00400951e640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:47.986528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.023149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.026315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1a825-20c0-496e-ad5e-00400951e640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.027794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1a825-20c0-496e-ad5e-00400951e640 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.036546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267a082-830d-4745-87dd-08d32717c95e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.075635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.076770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.077272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.077776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.088669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.090422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:48.114016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:48.114986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:48.115904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:48.115904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:48.115904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:48.115904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:48.118611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 333/673] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:48.119923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.142497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 341/674] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:48.143598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1a825-20c0-496e-ad5e-00400951e640 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.244133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b55a31-3bf0-4ad8-a5f2-e541f5066f0b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.260014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.266583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1a825-20c0-496e-ad5e-00400951e640 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.280314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.283068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.284259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.284749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.285488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.286525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:48.287557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.289127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.308228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 334/675] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:48.309455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.311629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.312814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.313279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.314344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.315090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:48.315400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.320572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.339011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 342/676] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:48.342495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.439328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9619d-dfb4-449c-9bc5-fb52aedf92ba None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.460890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc769-b8af-47b7-a54d-441d84e903ee None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.492909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.494770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.495214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.495898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.501683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.502512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.503039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.503432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.504417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=a4d11748f14d40628414db49de696fd4) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:48.504982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.506493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.510219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.512242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.518370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 343/677] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/role_assignments?user.id=a4d11748f14d40628414db49de696fd4&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:48.520368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:48.533164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:48.534200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:48.535699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:48.535699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:48.535699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:48.535699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:48.538114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 335/678] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:48.547522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.576500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.583380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.674156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e4d7-9d2f-482a-bc34-88bf5cfa0c6c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.714405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.715173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.715461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.715740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.716481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:48.717003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.719015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.733447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 336/679] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:48.739102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.806278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c11d62-ecd9-4eed-a001-92d889c53eaa None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.844245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.845048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.845334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.845611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.853649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.855160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:48.870260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:48.871255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:48.872188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 344/680] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:48.873557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:48.882961 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.891874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8f083-74a3-4d61-ae8f-9e22b9a50daf None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:48.932623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:48.933421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:48.933705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:48.934041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:48.942667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:48.944136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:48.961040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:48.962211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:48.963431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 337/681] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:48.967884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:48.995690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.011588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e9c04-a795-4e01-b8ed-f7e5f7a5c351 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.066990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3136a9-83ae-4573-87e1-6dac40882e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.067769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3136a9-83ae-4573-87e1-6dac40882e1c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.068125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3136a9-83ae-4573-87e1-6dac40882e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.068732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3136a9-83ae-4573-87e1-6dac40882e1c None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.070320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3136a9-83ae-4573-87e1-6dac40882e1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:49.070711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3136a9-83ae-4573-87e1-6dac40882e1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.072221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3136a9-83ae-4573-87e1-6dac40882e1c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.086948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23fd4a-6d6c-4432-a365-3af0afde6086 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.095913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 345/682] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:49.097518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fdd8-5ad4-4427-8840-c9922669c44a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.098019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fdd8-5ad4-4427-8840-c9922669c44a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.098446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fdd8-5ad4-4427-8840-c9922669c44a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.100139 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 346/683] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:49.101295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5fdd8-5ad4-4427-8840-c9922669c44a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.134310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323b2ac-4426-4510-a1b5-c611b4e2ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.144029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323b2ac-4426-4510-a1b5-c611b4e2ca55 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.144029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323b2ac-4426-4510-a1b5-c611b4e2ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.144029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323b2ac-4426-4510-a1b5-c611b4e2ca55 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.144029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323b2ac-4426-4510-a1b5-c611b4e2ca55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:49.144029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323b2ac-4426-4510-a1b5-c611b4e2ca55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.144029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323b2ac-4426-4510-a1b5-c611b4e2ca55 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.152639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 338/684] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:49.154016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa99e-78fb-4f9a-83df-e9e6779e2eb8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.154317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa99e-78fb-4f9a-83df-e9e6779e2eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.154600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa99e-78fb-4f9a-83df-e9e6779e2eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.162040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.177589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e0aaa99e-78fb-4f9a-83df-e9e6779e2eb8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:49.179788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e0aaa99e-78fb-4f9a-83df-e9e6779e2eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:49.234123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5fdd8-5ad4-4427-8840-c9922669c44a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.266146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 339/685] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:49.266146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaa99e-78fb-4f9a-83df-e9e6779e2eb8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.283997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5beb-8a25-41c2-a173-53b0471eb835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.285231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5beb-8a25-41c2-a173-53b0471eb835 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.285686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5beb-8a25-41c2-a173-53b0471eb835 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.286135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5beb-8a25-41c2-a173-53b0471eb835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.308744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.371214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaa99e-78fb-4f9a-83df-e9e6779e2eb8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.375101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c5beb-8a25-41c2-a173-53b0471eb835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.376707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c5beb-8a25-41c2-a173-53b0471eb835 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.409351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.410092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.410471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.410688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.411581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=35763651d4614bf68400b5efce4113a1) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:49.411832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.413339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.416225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.420682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 340/686] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/role_assignments?user.id=35763651d4614bf68400b5efce4113a1&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:49.421469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.492363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 347/687] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:49.501518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5beb-8a25-41c2-a173-53b0471eb835 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.537201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1042e72-e321-4af8-a432-1ae6f8a62918 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.579048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec683704-2084-4b9d-8b7f-845dbe7de87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.579048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683704-2084-4b9d-8b7f-845dbe7de87e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.579048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683704-2084-4b9d-8b7f-845dbe7de87e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.579048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec683704-2084-4b9d-8b7f-845dbe7de87e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.586377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.594024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec683704-2084-4b9d-8b7f-845dbe7de87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ec683704-2084-4b9d-8b7f-845dbe7de87e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:49.601093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:49.602903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:49.603720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 341/688] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:49.616082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec683704-2084-4b9d-8b7f-845dbe7de87e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.683157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.685226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5beb-8a25-41c2-a173-53b0471eb835 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.723943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.725151 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.725539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.725912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.735873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec683704-2084-4b9d-8b7f-845dbe7de87e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.749633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.751370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:49.771162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:49.772144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:49.773027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:49.773027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:49.773027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:49.773027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:49.773027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 348/689] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:49.778023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.786625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.787684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.788668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.789184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.790169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:49.791176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.793459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.805951 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 342/690] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:49.811046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:49.906892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.916890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac20d2d-c1e0-4b0c-b1f6-690f72b5015b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.954948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02d46c-208c-487e-90f2-7a9f0fc19a54 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:49.966121 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:49.967247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:49.967744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:49.968234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:49.969166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:49.969677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:49.971299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:49.983071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:49.986480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 349/691] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:49.991834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.016719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.019606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.021852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.022802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.046162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.046162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:50.074312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:50.075332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:50.076221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:50.076221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:50.076221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:50.076221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:50.086303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 343/692] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:50.087230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.138534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f3758-f403-4fff-97c1-8daecd522f8c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.194704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ddc53-67b5-4a87-afa4-091e962e2ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.195782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ddc53-67b5-4a87-afa4-091e962e2ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.196072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ddc53-67b5-4a87-afa4-091e962e2ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.196346 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ddc53-67b5-4a87-afa4-091e962e2ab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.203946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ddc53-67b5-4a87-afa4-091e962e2ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.205407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ddc53-67b5-4a87-afa4-091e962e2ab8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.209542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dff1e-8c65-4ee5-9d00-23010bafa4dd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-829ddc53-67b5-4a87-afa4-091e962e2ab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:50.234593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:50.235529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:50.236425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:50.236425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:50.236425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:50.236425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:50.236425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:50.236425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:50.236425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:50.236425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:50.240681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 350/693] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:50.242164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349666-3c95-45dc-a456-30d36eafbede None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.242456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349666-3c95-45dc-a456-30d36eafbede None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.242738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce349666-3c95-45dc-a456-30d36eafbede None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.244884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909882ec-d0cf-4930-b32a-8d1740ca0237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.245545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909882ec-d0cf-4930-b32a-8d1740ca0237 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.245828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909882ec-d0cf-4930-b32a-8d1740ca0237 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.246362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909882ec-d0cf-4930-b32a-8d1740ca0237 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.246865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909882ec-d0cf-4930-b32a-8d1740ca0237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:50.247169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909882ec-d0cf-4930-b32a-8d1740ca0237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.248219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 351/694] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:50.248544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909882ec-d0cf-4930-b32a-8d1740ca0237 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.249012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce349666-3c95-45dc-a456-30d36eafbede None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.261529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 344/695] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:50.267018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172627b-27d4-4049-8355-7a71e42bf9d7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.267314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172627b-27d4-4049-8355-7a71e42bf9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.267595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172627b-27d4-4049-8355-7a71e42bf9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.273844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:50.284518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6172627b-27d4-4049-8355-7a71e42bf9d7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:50.288835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6172627b-27d4-4049-8355-7a71e42bf9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:50.314464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:50.378260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 345/696] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:50.381991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172627b-27d4-4049-8355-7a71e42bf9d7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.383341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce349666-3c95-45dc-a456-30d36eafbede None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.451804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.452469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.452758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.453038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.454123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:50.454446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.457322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.475072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 352/697] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:50.475966 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.495809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172627b-27d4-4049-8355-7a71e42bf9d7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.545830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.546917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.547206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.547887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.557922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.559409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.561306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:50.580036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:50.580976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:50.582547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:50.583082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 346/698] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:56:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:50.583670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.587564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ff6a3-a632-4a1a-b5d8-4b6e878cb662 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.616651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:50.626253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.627102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.627386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.632233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.639878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.641429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:50.665010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:50.667127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:50.669347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:50.669347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:50.669347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:50.669347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:50.669347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 353/699] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:50.669347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.718928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9701f3-f5d4-4437-bc06-e0b083f5562f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.767852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.768528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.768818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.769129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.770292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=8eb03f76d840406ebe2365fd092d72f4) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:50.770611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.772711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.782007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 347/700] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:50 2022] GET /identity/v3/role_assignments?user.id=8eb03f76d840406ebe2365fd092d72f4&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:50.782007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:50.801236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d8b2e-2b20-4dfe-a61d-24501c8c5d2f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.856882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:50.879080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:50.879927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:50.880304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:50.880676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:50.881619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:50.882145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:50.883919 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:50.894483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:50.905841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68511fa9-9eaf-4ae6-a81c-430faa1769da None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:50.932155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 354/701] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:56:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:50.937245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:51.006849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:51.007548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:51.007836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:51.008113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:51.008865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:51.009172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:51.010813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:51.030126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 348/702] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:51.036182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:51.083451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e4c1a-5eb3-4887-8439-f2664e36d185 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:51.126867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebef7c5-8dd2-4d63-a5ba-d55b889cb406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:51.127540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef7c5-8dd2-4d63-a5ba-d55b889cb406 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:51.127901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef7c5-8dd2-4d63-a5ba-d55b889cb406 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:51.128316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef7c5-8dd2-4d63-a5ba-d55b889cb406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:51.190427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e90f-fe8a-4f8c-a3ee-4bf9bdbc2216 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:51.202714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:51.223375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebef7c5-8dd2-4d63-a5ba-d55b889cb406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:51.225201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebef7c5-8dd2-4d63-a5ba-d55b889cb406 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:51.234159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea40e8e-1c6a-4c4f-831e-454ffbae1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:51.235178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea40e8e-1c6a-4c4f-831e-454ffbae1890 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:51.235662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea40e8e-1c6a-4c4f-831e-454ffbae1890 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:51.236225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea40e8e-1c6a-4c4f-831e-454ffbae1890 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:51.237129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea40e8e-1c6a-4c4f-831e-454ffbae1890 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:51.239146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea40e8e-1c6a-4c4f-831e-454ffbae1890 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:51.315384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 349/703] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:56:51 2022] POST /identity/v3/users => generated 254 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:56:51.348996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 355/704] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:51.354578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea40e8e-1c6a-4c4f-831e-454ffbae1890 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:51.358019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:51.382317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688f1c-5801-48be-b88b-f46fe7eed675 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:51.382628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688f1c-5801-48be-b88b-f46fe7eed675 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:51.382807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688f1c-5801-48be-b88b-f46fe7eed675 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:51.384512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 356/705] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:56:51.391961 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763dc64-74a8-4e1c-bd61-8b8eaee910eb None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:51.392299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763dc64-74a8-4e1c-bd61-8b8eaee910eb None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:51.392606 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763dc64-74a8-4e1c-bd61-8b8eaee910eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:51.421177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-3763dc64-74a8-4e1c-bd61-8b8eaee910eb None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:51.422464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3763dc64-74a8-4e1c-bd61-8b8eaee910eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:51.519628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea40e8e-1c6a-4c4f-831e-454ffbae1890 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:51.572211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:51.573021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:51.573311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:51.573585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:51.588284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 357/706] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:51.591211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:51.592652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:51.611393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:51.612356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:51.613831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:51.613831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:51.613831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:51.613831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:51.613831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 350/707] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:51.619869 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763dc64-74a8-4e1c-bd61-8b8eaee910eb None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:51.621210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:51.638940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:51.694326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:51.753449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5161a-d4cc-4e39-a0d3-c11d1dce6d9a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:51.759994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763dc64-74a8-4e1c-bd61-8b8eaee910eb None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:51.799703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:51.801235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:51.801642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:51.802060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:51.803082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:51.803484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:51.805676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:51.809324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:51.810350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:51.810829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:51.811249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:51.812043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:51.814100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:51.822980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 351/708] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:51.825841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:51.836211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:51.837427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:56:51.838362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:51.841573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 358/709] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 30 11:56:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:51.848326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.000136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:52.026876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42e54c-d26c-4973-a24d-513b2ce9e246 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.044912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bad33-2ceb-48df-a0b5-531144478955 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.070388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:52.094740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.095540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.095821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.096091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.103759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.104425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.104712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.104985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.105694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:52.106101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:52.111246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:52.113877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:52.115459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:52.124396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 359/710] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 30 11:56:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:52.133993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:52.140641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:52.141730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 352/711] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:52.143286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.143546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.247978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f035f-d7f9-43f6-b3a8-ecb801d2498f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.282261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552190e-0bf8-4ef4-9113-67aa2ba5b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.282989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552190e-0bf8-4ef4-9113-67aa2ba5b5af None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.283606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552190e-0bf8-4ef4-9113-67aa2ba5b5af None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.283723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552190e-0bf8-4ef4-9113-67aa2ba5b5af None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.284507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552190e-0bf8-4ef4-9113-67aa2ba5b5af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:52.284931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552190e-0bf8-4ef4-9113-67aa2ba5b5af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:52.286463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552190e-0bf8-4ef4-9113-67aa2ba5b5af None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:52.293284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 353/712] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:52.315635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56123-575c-419d-9bae-aa598ba32d8c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.316632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56123-575c-419d-9bae-aa598ba32d8c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.317011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56123-575c-419d-9bae-aa598ba32d8c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.318806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 354/713] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:52.320640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9628c7-9271-4f8f-8345-407767090ee5 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.333582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ce0bf-9a05-4acb-9f3e-60f2ce9d2e86 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.334062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ce0bf-9a05-4acb-9f3e-60f2ce9d2e86 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.334349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ce0bf-9a05-4acb-9f3e-60f2ce9d2e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.364810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-759ce0bf-9a05-4acb-9f3e-60f2ce9d2e86 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:52.367086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-759ce0bf-9a05-4acb-9f3e-60f2ce9d2e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:52.369028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.369711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.370017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.370302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.371106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:52.371422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:52.372913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:52.404360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 360/714] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:52.410470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.414633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:52.438870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:52.487650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 355/715] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:52.514935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ce0bf-9a05-4acb-9f3e-60f2ce9d2e86 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.587029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96224047-88fb-4838-a755-bc7582bb4a18 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.628519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.629328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.629886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.630245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.631080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=7ca17dc23a924e41a657db3122445923) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:52.631390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:52.632830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:52.641339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 361/716] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/role_assignments?user.id=7ca17dc23a924e41a657db3122445923&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=f3f138e4021a4b7dada39089dd427266 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:52.652325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ce0bf-9a05-4acb-9f3e-60f2ce9d2e86 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.693048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.693914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.694249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.694530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.695450 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:52.696841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:52.711657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:52.714136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:52.716178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 356/717] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:52.723028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.794300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:52.832585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73737-483f-433e-996f-08303dc32f70 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:52.871549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c8609-5b35-42f1-8091-8a3286b4d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:52.872623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c8609-5b35-42f1-8091-8a3286b4d186 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:52.872915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c8609-5b35-42f1-8091-8a3286b4d186 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:52.873200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c8609-5b35-42f1-8091-8a3286b4d186 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:52.874029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c8609-5b35-42f1-8091-8a3286b4d186 None admin] RBAC: Adding query filter params (name=network) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:52.874351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c8609-5b35-42f1-8091-8a3286b4d186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:52.875751 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c8609-5b35-42f1-8091-8a3286b4d186 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:52.881201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 362/718] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:52.886672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:52.922894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:52.998850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e60dfd-0b51-45fb-a412-f5e2b5c3f3b4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:53.035310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805613dc-072e-45df-b16a-c3065aa4d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:53.035987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805613dc-072e-45df-b16a-c3065aa4d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:53.036278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805613dc-072e-45df-b16a-c3065aa4d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:53.036614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805613dc-072e-45df-b16a-c3065aa4d4d3 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:53.037345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805613dc-072e-45df-b16a-c3065aa4d4d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:53.037701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805613dc-072e-45df-b16a-c3065aa4d4d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:53.039147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805613dc-072e-45df-b16a-c3065aa4d4d3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:53.044439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 357/719] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:56:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:53.742272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad414c6-976b-4abe-9c62-1b34011a87c6 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:53.742984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad414c6-976b-4abe-9c62-1b34011a87c6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:53.742984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad414c6-976b-4abe-9c62-1b34011a87c6 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:53.744474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 363/720] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:53.755385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1ab8-cb92-4869-b243-b369427edd80 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:53.755854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1ab8-cb92-4869-b243-b369427edd80 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:53.755957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1ab8-cb92-4869-b243-b369427edd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:53.777366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0edc1ab8-cb92-4869-b243-b369427edd80 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:53.778641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0edc1ab8-cb92-4869-b243-b369427edd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:53.852611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 358/721] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:53.875952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad414c6-976b-4abe-9c62-1b34011a87c6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.033660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad414c6-976b-4abe-9c62-1b34011a87c6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.071103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:54.081008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c73fe-21aa-44fd-8202-0e40a1020c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.082359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c73fe-21aa-44fd-8202-0e40a1020c5d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.082647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c73fe-21aa-44fd-8202-0e40a1020c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.085199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c73fe-21aa-44fd-8202-0e40a1020c5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.102850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c73fe-21aa-44fd-8202-0e40a1020c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-9e1c73fe-21aa-44fd-8202-0e40a1020c5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:54.110638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:54.111543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:54.112368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 364/722] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:54.118725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1ab8-cb92-4869-b243-b369427edd80 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.142957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0df7-fd06-40ec-b646-a7f32eba046b None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.143252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0df7-fd06-40ec-b646-a7f32eba046b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.143538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0df7-fd06-40ec-b646-a7f32eba046b None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.145459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 365/723] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:56:54.150878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b74b73-c0e0-4881-b1f7-1bc66762a0e9 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.151169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b74b73-c0e0-4881-b1f7-1bc66762a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.151451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b74b73-c0e0-4881-b1f7-1bc66762a0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.156354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:54.180165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-29b74b73-c0e0-4881-b1f7-1bc66762a0e9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:54.181664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-29b74b73-c0e0-4881-b1f7-1bc66762a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:54.279195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1ab8-cb92-4869-b243-b369427edd80 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.312932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 366/724] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 30 11:56:54.346861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b74b73-c0e0-4881-b1f7-1bc66762a0e9 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.347237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.348133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.348635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.349269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.350308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:54.350813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.353389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:54.364088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 359/725] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:54.369185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.513268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b74b73-c0e0-4881-b1f7-1bc66762a0e9 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.534550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:54.549809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d95a79-56ac-495e-bece-e1f43b06d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.555277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95a79-56ac-495e-bece-e1f43b06d18f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.555277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95a79-56ac-495e-bece-e1f43b06d18f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.555277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95a79-56ac-495e-bece-e1f43b06d18f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.557982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:54.564533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d95a79-56ac-495e-bece-e1f43b06d18f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-d7d95a79-56ac-495e-bece-e1f43b06d18f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:54.573723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:54.574775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:56:54.575638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:54.578306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 367/726] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:54.586168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62332bd-29b8-4e11-aafb-d4f19a6f771b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.587413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d95a79-56ac-495e-bece-e1f43b06d18f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.626764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.630512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.632693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.633195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.656137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.659122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:54.698315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:54.699267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:54.700171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:54.700171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:54.700171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:54.700171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:54.704427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 360/727] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:54.708222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.768534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d95a79-56ac-495e-bece-e1f43b06d18f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.806189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.807212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.807714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.808204 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.809171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:54.809671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.811327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:54.821642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 368/728] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:54.827650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:54.921856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:54.927341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c332d6c-cf50-4a3f-9593-ea3e6359430e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:54.986721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:54.987470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:54.987733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:54.988012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:54.988754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:54.989069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:54.991710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.005397 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1b80e-7a91-4747-a3e2-3bbc5f224a7c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:55.005991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:55.010106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 361/729] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:55.018568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:55.042979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:55.044131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.044611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.045077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.057893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:55.059772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:55.078694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:55.079572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:55.080464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:55.080464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:55.080464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:55.080464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:55.083318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 369/730] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:55.088800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:55.191427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:55.199713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322178e3-e59d-423a-9f6e-458aa2b54693 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:55.238598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:55.239652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.240245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.240721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.241679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:55.242222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:55.243969 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.259026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 370/731] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:55.264902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:55.266468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37acc0-e174-476e-8578-4ff0fbf01072 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:55.323289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fc670-981e-4045-94dd-7add33858705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:55.324087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc670-981e-4045-94dd-7add33858705 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.324369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc670-981e-4045-94dd-7add33858705 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.324762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc670-981e-4045-94dd-7add33858705 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.332688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc670-981e-4045-94dd-7add33858705 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:55.334119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc670-981e-4045-94dd-7add33858705 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e26fc670-981e-4045-94dd-7add33858705 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:55.349639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:55.350660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:56:55.351604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:55.355437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 362/732] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:55.356757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79dbd-0198-40c8-a1f6-024be1af038d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.357058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79dbd-0198-40c8-a1f6-024be1af038d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.357327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79dbd-0198-40c8-a1f6-024be1af038d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.363613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 363/733] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:55.363613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79dbd-0198-40c8-a1f6-024be1af038d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:55.396962 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019db13-04eb-4f30-959a-1bd65c483273 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:55.423166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:55.434340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e770f-89b2-48ff-82d0-2a931f8d0f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:55.435415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e770f-89b2-48ff-82d0-2a931f8d0f6c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.435923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e770f-89b2-48ff-82d0-2a931f8d0f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.436367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e770f-89b2-48ff-82d0-2a931f8d0f6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.448208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e770f-89b2-48ff-82d0-2a931f8d0f6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:55.450495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e770f-89b2-48ff-82d0-2a931f8d0f6c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.473142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79dbd-0198-40c8-a1f6-024be1af038d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-f73e770f-89b2-48ff-82d0-2a931f8d0f6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:55.474375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:55.475402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:56:55.476339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:55.479764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 371/734] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 11:56:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:56:55.481177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa077-2854-4ddb-941c-0a1f26e41535 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.481609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa077-2854-4ddb-941c-0a1f26e41535 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.482066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa077-2854-4ddb-941c-0a1f26e41535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.501351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-eb4aa077-2854-4ddb-941c-0a1f26e41535 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:55.503025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-eb4aa077-2854-4ddb-941c-0a1f26e41535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:55.514342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:55.515189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.515645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.516030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.517033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:55.517448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:55.519360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.526339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:55.543903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 364/735] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 30 11:56:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:55.543903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:55.590498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 372/736] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:55.591891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa077-2854-4ddb-941c-0a1f26e41535 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:55.653094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992460a-45dc-4ad7-a950-7eccf4cf7a62 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:55.672626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:55.690419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2c587-ce31-4340-a83c-fbf80b13d3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:55.691117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c587-ce31-4340-a83c-fbf80b13d3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.691408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c587-ce31-4340-a83c-fbf80b13d3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.691689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c587-ce31-4340-a83c-fbf80b13d3c8 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.692674 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c587-ce31-4340-a83c-fbf80b13d3c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:55.692994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c587-ce31-4340-a83c-fbf80b13d3c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:55.694477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c587-ce31-4340-a83c-fbf80b13d3c8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.712219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 365/737] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 30 11:56:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:55.712764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa077-2854-4ddb-941c-0a1f26e41535 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:55.714219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a877a3-ad90-4714-9f72-14043122c1e1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.714717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a877a3-ad90-4714-9f72-14043122c1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.715213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a877a3-ad90-4714-9f72-14043122c1e1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.720923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 366/738] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:55.722478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a877a3-ad90-4714-9f72-14043122c1e1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:55.759634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ee8a8-7ac3-410a-a970-6e4324a5f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:55.760848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ee8a8-7ac3-410a-a970-6e4324a5f2bb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.761194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ee8a8-7ac3-410a-a970-6e4324a5f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.761415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ee8a8-7ac3-410a-a970-6e4324a5f2bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.776981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:55.834177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ee8a8-7ac3-410a-a970-6e4324a5f2bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:55.835649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ee8a8-7ac3-410a-a970-6e4324a5f2bb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.838809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a877a3-ad90-4714-9f72-14043122c1e1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:55.873766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4024fc-d9f0-45fe-a154-229c50bcb3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:55.874381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4024fc-d9f0-45fe-a154-229c50bcb3e1 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.874665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4024fc-d9f0-45fe-a154-229c50bcb3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.874940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4024fc-d9f0-45fe-a154-229c50bcb3e1 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.875658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4024fc-d9f0-45fe-a154-229c50bcb3e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:55.877021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4024fc-d9f0-45fe-a154-229c50bcb3e1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:55.937434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 373/739] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:55.938338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ee8a8-7ac3-410a-a970-6e4324a5f2bb None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:55.973991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 367/740] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:56:55 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:56:55.973991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220dea-624b-44e7-ab81-c72a872ee84f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:55.973991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220dea-624b-44e7-ab81-c72a872ee84f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:55.973991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220dea-624b-44e7-ab81-c72a872ee84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:55.985722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:55.986139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d7220dea-624b-44e7-ab81-c72a872ee84f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:55.987573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d7220dea-624b-44e7-ab81-c72a872ee84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:56.021630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:56.054515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ee8a8-7ac3-410a-a970-6e4324a5f2bb None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.081939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 368/741] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:56.083665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7c47-9c3c-4816-948a-9455ff147a69 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.084144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7c47-9c3c-4816-948a-9455ff147a69 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.084637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7c47-9c3c-4816-948a-9455ff147a69 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.086270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 369/742] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:56.087173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a7c47-9c3c-4816-948a-9455ff147a69 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:56.109511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade95f1-32ef-4d93-8a9e-c3b6d12fbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:56.110401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade95f1-32ef-4d93-8a9e-c3b6d12fbe10 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.110693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade95f1-32ef-4d93-8a9e-c3b6d12fbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.110970 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade95f1-32ef-4d93-8a9e-c3b6d12fbe10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.199016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade95f1-32ef-4d93-8a9e-c3b6d12fbe10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:56.200441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade95f1-32ef-4d93-8a9e-c3b6d12fbe10 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:56.206050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a7c47-9c3c-4816-948a-9455ff147a69 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.245528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309187c-dbd1-4e07-b909-f7b941e407b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:56.246483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:56.247380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309187c-dbd1-4e07-b909-f7b941e407b0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.247748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309187c-dbd1-4e07-b909-f7b941e407b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.248038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309187c-dbd1-4e07-b909-f7b941e407b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.259011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309187c-dbd1-4e07-b909-f7b941e407b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:56.260655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309187c-dbd1-4e07-b909-f7b941e407b0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7309187c-dbd1-4e07-b909-f7b941e407b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:56.279636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:56.280617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:56.281487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:56.281487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:56.281487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:56.281487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:56.285392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 370/743] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:56.286585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1049f5-b2b1-4f30-ae10-869b15b24920 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.286882 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1049f5-b2b1-4f30-ae10-869b15b24920 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.287158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1049f5-b2b1-4f30-ae10-869b15b24920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.305535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4c1049f5-b2b1-4f30-ae10-869b15b24920 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:56.310914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 374/744] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:56:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 30 11:56:56.311050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4c1049f5-b2b1-4f30-ae10-869b15b24920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:56.311143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade95f1-32ef-4d93-8a9e-c3b6d12fbe10 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:56.321323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:56.383469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 371/745] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 30 11:56:56.384231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1049f5-b2b1-4f30-ae10-869b15b24920 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:56.429024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade95f1-32ef-4d93-8a9e-c3b6d12fbe10 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.465701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e343d-22ba-4829-9423-dcb6867030b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:56.466474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e343d-22ba-4829-9423-dcb6867030b4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.466763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e343d-22ba-4829-9423-dcb6867030b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.467038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e343d-22ba-4829-9423-dcb6867030b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.478646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e343d-22ba-4829-9423-dcb6867030b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-159e343d-22ba-4829-9423-dcb6867030b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:56:56.486574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:56.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 375/746] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:56.488410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e343d-22ba-4829-9423-dcb6867030b4 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:56.494375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:56.494644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1049f5-b2b1-4f30-ae10-869b15b24920 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.534867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:56.535810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.536098 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.536378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.537253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:56.537912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:56.539680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:56.558278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 372/747] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:56.558278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:56.564197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:56.594255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e343d-22ba-4829-9423-dcb6867030b4 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.633783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:56.634812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.635385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.636530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.648696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:56.649935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:56.667313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7393f-8f78-4a2b-a7db-1f2c97a53b21 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:56.667497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:56.668486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:56.669665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:56.669665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:56.669665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:56.669665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:56.673291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 376/748] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:56.673896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:56.705452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf478c49-cfed-4d89-9982-80e859ea0276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:56.706336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf478c49-cfed-4d89-9982-80e859ea0276 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.706453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf478c49-cfed-4d89-9982-80e859ea0276 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.706740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf478c49-cfed-4d89-9982-80e859ea0276 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.707465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf478c49-cfed-4d89-9982-80e859ea0276 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:56.708976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf478c49-cfed-4d89-9982-80e859ea0276 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:56.734536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:56.777855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664284d-d428-427b-b975-26268eb5b25a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.790341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 373/749] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:56:56 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:56:56.790341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf478c49-cfed-4d89-9982-80e859ea0276 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:56.829638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:56.830338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.830623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.830896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.831691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:56.831998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:56.833388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:56.843593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 377/750] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:56:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:56.844259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:56.879074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:56.917916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf478c49-cfed-4d89-9982-80e859ea0276 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.957839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:56.958758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:56.959049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:56.959327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:56.967585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:56.969072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:56.974654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3af2b1-58ca-4234-b573-fe05e9d202ee None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:56.985779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:56.987241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:56.989459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:56.989459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:56.989459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:56.989459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:56.989459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:56.989459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:56.989459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:56.989459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:56.991337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 374/751] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:56.993280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:56.994945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.015658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.016441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.016807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.017166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.017904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.018256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.019748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.032458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 378/752] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:57.035257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.129154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ac97c-ffa8-45f4-abf2-36eb8af72e89 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.154921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:57.158416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4b43e-9a0e-47e8-bb2f-0e9f2a6d8168 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.167036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.168104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.168587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.169055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.179713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.181421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.195092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.195860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.196217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.196563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.197434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.197809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.199753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:57.202261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:57.203103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:57.203991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:57.203991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:57.203991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:57.203991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:57.207058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 375/753] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:57.208281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.214137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 379/754] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:57.214978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.255398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:57.315252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4e12d-1773-4094-825d-72a64aa359e1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.328911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef1f0-f48b-4713-abb4-6ffd2b15df76 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.352279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.353247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.353623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.354016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.360998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.363125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.367074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.367909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.368344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.368782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.369662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.370160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.371707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:57.378877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:57.379773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:57.380654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 376/755] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:57.381286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.387794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 380/756] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:57.388842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.419791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:57.488041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:57.491144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853cfbb-0483-4f35-a5cc-861e7a294316 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.495255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0658-8ae8-4bbf-a430-3539db451df9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.526586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.527541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.527981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.528321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.529468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=8eb03f76d840406ebe2365fd092d72f4) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.529843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.530089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.530819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.531176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.531526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.531641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.532500 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.532889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.534446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.537800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 377/757] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/role_assignments?user.id=8eb03f76d840406ebe2365fd092d72f4&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=f3f138e4021a4b7dada39089dd427266 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:57.538726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.560542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 381/758] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:57.567216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.651445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:57.655734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d31b9c-6821-4408-bb0c-9bca63bf0e5c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.713162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081bf18-012e-4ce6-8a43-374587c300b7 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.716356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.717442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.717931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.718472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.739034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.740994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.755448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.756114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.756401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.756680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.757533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=987e7ae8a7a24af8b391474e711051b1) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.757847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.759376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.766188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 382/759] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/role_assignments?user.id=987e7ae8a7a24af8b391474e711051b1&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:56:57.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:57.776389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:57.777363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 378/760] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:57.785141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:57.821550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:57.929071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f913ef1-93bb-49c3-a514-fd38349a81ef None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:57.966372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:57.967057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:57.967342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:57.967625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:57.968477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:57.968789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:57.970265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:57.997009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 383/761] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:56:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:58.002993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:58.126333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f838e37-eed3-4d81-9b0d-4d2e7a2cbff9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:58.171437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bfe3e-e6a8-4633-8d7e-f5501f3e7bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:58.172262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bfe3e-e6a8-4633-8d7e-f5501f3e7bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:58.172538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bfe3e-e6a8-4633-8d7e-f5501f3e7bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:58.172819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bfe3e-e6a8-4633-8d7e-f5501f3e7bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:58.189816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bfe3e-e6a8-4633-8d7e-f5501f3e7bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:58.191344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bfe3e-e6a8-4633-8d7e-f5501f3e7bf8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4a5bfe3e-e6a8-4633-8d7e-f5501f3e7bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:56:58.213657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:58.214634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:58.215517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:56:58.215517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:56:58.215517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:56:58.215517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:58.215517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 379/762] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:58.221808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:58.337832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:58.363992 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1ec81-e20a-432d-b9ac-74c72a412d15 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:58.364280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1ec81-e20a-432d-b9ac-74c72a412d15 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:58.364567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1ec81-e20a-432d-b9ac-74c72a412d15 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:58.366211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 380/763] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:56:58.370548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c79e90-b606-4718-bc77-62cf775c99a9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:58.371360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba1c12-4a48-48d6-9927-4dc1385899b7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:58.371653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba1c12-4a48-48d6-9927-4dc1385899b7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:58.371936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba1c12-4a48-48d6-9927-4dc1385899b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:58.390327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-baba1c12-4a48-48d6-9927-4dc1385899b7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:58.391435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-baba1c12-4a48-48d6-9927-4dc1385899b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:58.411349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:58.422242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:58.431435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:58.431435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:58.431435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:58.431435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:58.431435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:58.431435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:58.440617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 384/764] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:58.446394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:58.531271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 381/765] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:56:58.555028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba1c12-4a48-48d6-9927-4dc1385899b7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:58.658514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ddc0d-3f23-43dc-9968-c83c9a1cd029 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:58.719301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba1c12-4a48-48d6-9927-4dc1385899b7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:58.758126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:58.759286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:58.759907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:58.760512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:58.761434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:58.762338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:58.763213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:58.763432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:58.763601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:58.763999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:58.775265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:58.780549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:58.781461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:56:58.782374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:58.785586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 382/766] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 30 11:56:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:58.786838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:58.788809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:58.791072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:58.807769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:56:58.821314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:58.822238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:58.823130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:56:58.823130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:56:58.823130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:56:58.823130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:56:58.823130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:56:58.823130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:56:58.823130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:56:58.823130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:56:58.828070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 385/767] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:58.838939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:58.936492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c569b3-d1a4-43b3-af18-c563d5fcfb85 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:59.016837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:59.017616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.017790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.018099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.018826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:59.019141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:59.020527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:59.033692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 383/768] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 30 11:56:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:59.036638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:59.070546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec14b49-5b8c-492f-864b-f0a417f51912 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:59.111187 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:59.112172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.113031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.113314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.114559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:59.115430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:59.117222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:59.134277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 386/769] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:59.140646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:59.165932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:59.214687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d1830-6501-467f-97af-370ee5e58df4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:59.252862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:59.253614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.253907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.254218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.254929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:59.255241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:59.256628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:59.262078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 384/770] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 30 11:56:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:59.270570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:59.273576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:59.364734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01af758-c40f-4962-8173-ca3514b1f09a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:59.412528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1b012-8232-42cf-b97c-14260ef49abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:59.413473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b012-8232-42cf-b97c-14260ef49abf None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.413765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b012-8232-42cf-b97c-14260ef49abf None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.417946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b012-8232-42cf-b97c-14260ef49abf None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/7ca17dc23a924e41a657db3122445923/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.420050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1b012-8232-42cf-b97c-14260ef49abf None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=7ca17dc23a924e41a657db3122445923, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:59.421509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1b012-8232-42cf-b97c-14260ef49abf None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:59.450239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41c7a-be12-4693-b81f-14ad39d86094 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:59.486281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc15f4-5eae-4176-bed5-b27d493cf69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:59.486948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc15f4-5eae-4176-bed5-b27d493cf69d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.487252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc15f4-5eae-4176-bed5-b27d493cf69d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.488069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc15f4-5eae-4176-bed5-b27d493cf69d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.488921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc15f4-5eae-4176-bed5-b27d493cf69d None admin] RBAC: Adding query filter params (interface=public, service_id=b964b8aa8a9f411b9e16e4036beabe08, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:56:59.489243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc15f4-5eae-4176-bed5-b27d493cf69d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:59.490649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc15f4-5eae-4176-bed5-b27d493cf69d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:59.492337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:59.508516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 385/772] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 30 11:56:59 2022] GET /identity/v3/endpoints?service_id=b964b8aa8a9f411b9e16e4036beabe08&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:56:59.508516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b451b1-1733-4961-9239-0cfa71ba6f49 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.508516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b451b1-1733-4961-9239-0cfa71ba6f49 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.508516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b451b1-1733-4961-9239-0cfa71ba6f49 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.508933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 386/773] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:56:59.509282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 387/773] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:56:59 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/7ca17dc23a924e41a657db3122445923/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:56:59.513987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b451b1-1733-4961-9239-0cfa71ba6f49 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:59.536102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668b64-63af-4c8c-86f3-0b70639defc0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.536749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668b64-63af-4c8c-86f3-0b70639defc0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.537221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668b64-63af-4c8c-86f3-0b70639defc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.577193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-fc668b64-63af-4c8c-86f3-0b70639defc0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:56:59.578780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-fc668b64-63af-4c8c-86f3-0b70639defc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:56:59.639456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b451b1-1733-4961-9239-0cfa71ba6f49 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:59.682804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f24cf8-8874-43e4-a1c0-f9ae6dd5d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:59.683488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f24cf8-8874-43e4-a1c0-f9ae6dd5d152 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.683807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f24cf8-8874-43e4-a1c0-f9ae6dd5d152 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.684103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f24cf8-8874-43e4-a1c0-f9ae6dd5d152 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.684919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f24cf8-8874-43e4-a1c0-f9ae6dd5d152 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:59.689983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f24cf8-8874-43e4-a1c0-f9ae6dd5d152 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:59.694180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 387/774] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 11:56:59 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:56:59.749282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 388/775] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:56:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:56:59.795648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f24cf8-8874-43e4-a1c0-f9ae6dd5d152 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:56:59.871882 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:56:59.918116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f24cf8-8874-43e4-a1c0-f9ae6dd5d152 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:56:59.962940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:56:59.963769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:56:59.964057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:56:59.964338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] PATH_INFO: `/v3/services/network` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:56:59.965016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:56:59.966508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:56:59.980052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:56:59.981087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:56:59.981944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 388/776] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:56:59 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:56:59.991373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc668b64-63af-4c8c-86f3-0b70639defc0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:00.073950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:00.139620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc668b64-63af-4c8c-86f3-0b70639defc0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:00.187749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764ed3a-34ca-48c7-b813-16a9962183d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:00.188432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ed3a-34ca-48c7-b813-16a9962183d9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.188715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ed3a-34ca-48c7-b813-16a9962183d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.188994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764ed3a-34ca-48c7-b813-16a9962183d9 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.189709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764ed3a-34ca-48c7-b813-16a9962183d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:00.190039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764ed3a-34ca-48c7-b813-16a9962183d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:00.191954 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764ed3a-34ca-48c7-b813-16a9962183d9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:00.203143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 389/777] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:56:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:00.209790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:00.324756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0290ea-eabd-472c-89ad-fb374e5527d1 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.325053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0290ea-eabd-472c-89ad-fb374e5527d1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.325239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0290ea-eabd-472c-89ad-fb374e5527d1 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.326778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 390/778] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:00.333184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716dc7a-5e65-4360-b879-23b1e453d942 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.333474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716dc7a-5e65-4360-b879-23b1e453d942 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.333807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716dc7a-5e65-4360-b879-23b1e453d942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.365447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7716dc7a-5e65-4360-b879-23b1e453d942 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:00.367037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7716dc7a-5e65-4360-b879-23b1e453d942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:00.378498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33157d27-0f18-4076-a41a-186f76e96fca None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:00.401203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:00.414581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:00.418681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.418681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.418681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.418681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] RBAC: Adding query filter params (type=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:00.419376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:00.420781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:00.432523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 389/779] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:00.438521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:00.508343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 391/780] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:00.538830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716dc7a-5e65-4360-b879-23b1e453d942 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:00.583451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:00.601104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863466-3c55-4791-a194-914e36a33885 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:00.647662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:00.648331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.648614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.648890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.649680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] RBAC: Adding query filter params (interface=public, service_id=1360cedbaca248a3899fe1eb99f16bd3, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:00.650006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:00.651405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:00.662181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 390/781] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 30 11:57:00 2022] GET /identity/v3/endpoints?service_id=1360cedbaca248a3899fe1eb99f16bd3&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:00.667602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:00.681149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716dc7a-5e65-4360-b879-23b1e453d942 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:00.718026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572d908-7e27-432d-9302-efd91a390f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:00.718837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572d908-7e27-432d-9302-efd91a390f15 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.719125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572d908-7e27-432d-9302-efd91a390f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.719504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572d908-7e27-432d-9302-efd91a390f15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.734472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:00.738766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572d908-7e27-432d-9302-efd91a390f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-f572d908-7e27-432d-9302-efd91a390f15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:00.749702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:00.754766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 392/782] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:00.756136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bfafd-0e8e-4697-9df7-c0b28b2dd988 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.756886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bfafd-0e8e-4697-9df7-c0b28b2dd988 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.756886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bfafd-0e8e-4697-9df7-c0b28b2dd988 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.756886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 393/783] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:00.763026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70d269-9b75-4bc3-84b3-4ccfac1bcab3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.763326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70d269-9b75-4bc3-84b3-4ccfac1bcab3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.763607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70d269-9b75-4bc3-84b3-4ccfac1bcab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.780176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf6e22-d6f6-458a-97c9-e7b05a2ea096 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:00.785684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9b70d269-9b75-4bc3-84b3-4ccfac1bcab3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:00.787123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9b70d269-9b75-4bc3-84b3-4ccfac1bcab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:00.820019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8403a99-c281-44e0-8c65-7f35552d5202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:00.820692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8403a99-c281-44e0-8c65-7f35552d5202 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:00.820975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8403a99-c281-44e0-8c65-7f35552d5202 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:00.821260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8403a99-c281-44e0-8c65-7f35552d5202 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:00.821950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8403a99-c281-44e0-8c65-7f35552d5202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:00.823367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8403a99-c281-44e0-8c65-7f35552d5202 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:00.834131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 391/784] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 11:57:00 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:00.834131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8403a99-c281-44e0-8c65-7f35552d5202 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:00.891052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 394/785] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:00.918414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70d269-9b75-4bc3-84b3-4ccfac1bcab3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:00.970267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:01.064429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70d269-9b75-4bc3-84b3-4ccfac1bcab3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:01.093733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8403a99-c281-44e0-8c65-7f35552d5202 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:01.113600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f42eb-9ab0-4068-b483-28a331fa1aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:01.114502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f42eb-9ab0-4068-b483-28a331fa1aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:01.114745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f42eb-9ab0-4068-b483-28a331fa1aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:01.115030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f42eb-9ab0-4068-b483-28a331fa1aa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:01.118227 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:01.129921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f42eb-9ab0-4068-b483-28a331fa1aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-798f42eb-9ab0-4068-b483-28a331fa1aa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:01.138804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:01.139767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:57:01.140598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:01.141236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:01.141236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:01.141236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:01.141236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:01.141499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:01.142387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:01.144506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:01.144698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 395/786] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:01.151650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f42eb-9ab0-4068-b483-28a331fa1aa3 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:01.161153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 392/787] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:01.166492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:01.370364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:01.379180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f42eb-9ab0-4068-b483-28a331fa1aa3 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:01.404746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffcff-7538-414d-9de0-a1936027a8c2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:01.444216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:01.445272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:01.445560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:01.445837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:01.458393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:01.460173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:01.461020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:01.461926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:01.462471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:01.462952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:01.463907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:01.464420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:01.466047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:01.480789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:01.481706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:01.482630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:01.482630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:01.482630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:01.482630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:01.482630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 393/788] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:01.488135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:01.488880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 396/789] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:01.503364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:01.528445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:01.608191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b247fe-4dbf-4b40-88c3-bd705a0a026e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:01.647851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:01.648435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:01.648725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:01.649004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:01.650191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:01.650508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:01.652065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:01.665248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 394/790] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:01.670241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:01.766896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfce07-fb5b-4140-b952-7020d0bda58f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:01.833767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:01.834624 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:01.834839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:01.834943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:01.835167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:01.852561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:01.862754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:01.862872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3915-8c62-4e97-b952-3588e1962a00 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:01.886022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:01.886958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:01.887912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:01.887912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:01.887912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:01.887912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:01.888626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 397/791] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:01.895970 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:01.910018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:01.919460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:01.920284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:01.927704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:01.927704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:01.935778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:01.937294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:01.960486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:01.961476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:57:01.962434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:01.966122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 395/792] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:57:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:01.968915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.084732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b556b9-0c85-42d5-a334-a808988ffea9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.122981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdc450-12d3-49aa-b036-7520601ab7b9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.141313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643533-2c1d-4860-973e-0ba4a08ca07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.142397 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643533-2c1d-4860-973e-0ba4a08ca07f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.142888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643533-2c1d-4860-973e-0ba4a08ca07f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.149986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643533-2c1d-4860-973e-0ba4a08ca07f None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.151217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91643533-2c1d-4860-973e-0ba4a08ca07f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:02.151754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91643533-2c1d-4860-973e-0ba4a08ca07f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.153588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91643533-2c1d-4860-973e-0ba4a08ca07f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.158364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.159071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.159361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.159644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.160549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:02.160811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.169984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.180123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 398/793] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:02.185711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 396/794] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 30 11:57:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:02.185816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee2a0-dd33-48e9-8729-4d9abf589370 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.185816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee2a0-dd33-48e9-8729-4d9abf589370 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.185816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee2a0-dd33-48e9-8729-4d9abf589370 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.185816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 399/795] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:02.188146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.192087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acb754-cbaa-41ea-a980-32bb2c82281b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.192383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acb754-cbaa-41ea-a980-32bb2c82281b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.193564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acb754-cbaa-41ea-a980-32bb2c82281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.202306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.214904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-51acb754-cbaa-41ea-a980-32bb2c82281b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:02.216416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-51acb754-cbaa-41ea-a980-32bb2c82281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:02.305611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.308151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d34ed-75ef-4c46-8897-7b7f40f59998 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.318044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 400/796] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:02.319164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acb754-cbaa-41ea-a980-32bb2c82281b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.360909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.362084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.363058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.363348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.370853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.372309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:02.387597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:02.388564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:02.389494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 397/797] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:02.390165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.447973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acb754-cbaa-41ea-a980-32bb2c82281b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.462867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.483028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85d256-9f53-4d30-a2df-512caecfc9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.483836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85d256-9f53-4d30-a2df-512caecfc9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.484147 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85d256-9f53-4d30-a2df-512caecfc9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.484429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85d256-9f53-4d30-a2df-512caecfc9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.494931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85d256-9f53-4d30-a2df-512caecfc9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.496271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d06537-252f-4b8d-85cc-d79f65b89186 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.496395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85d256-9f53-4d30-a2df-512caecfc9e3 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-5b85d256-9f53-4d30-a2df-512caecfc9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:02.513675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:02.514817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:02.515753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:02.515753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:02.515753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:02.515753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:02.515753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 401/798] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:02.516417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb18c5-1e51-44fa-9f44-0f6705631d5f None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.516702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb18c5-1e51-44fa-9f44-0f6705631d5f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.516981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb18c5-1e51-44fa-9f44-0f6705631d5f None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.522255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 402/799] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:02.523007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb18c5-1e51-44fa-9f44-0f6705631d5f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.538756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.539890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.540355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.540783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.541694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.543409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:02.557123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:02.558344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 30 11:57:02.559381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:02.561886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 398/800] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:02.562888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.574178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.629434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb18c5-1e51-44fa-9f44-0f6705631d5f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.664890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c73142-4dee-4e99-b972-983aafeab532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.665553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c73142-4dee-4e99-b972-983aafeab532 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.665849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c73142-4dee-4e99-b972-983aafeab532 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.666160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c73142-4dee-4e99-b972-983aafeab532 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.667000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c73142-4dee-4e99-b972-983aafeab532 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:02.667312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c73142-4dee-4e99-b972-983aafeab532 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.668764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c73142-4dee-4e99-b972-983aafeab532 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.673201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12655566-c75a-419c-9f76-1e9dff184418 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.689447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 403/801] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:02.690754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cc665-3b30-41fb-adb3-31928df63825 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.691042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cc665-3b30-41fb-adb3-31928df63825 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.691320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cc665-3b30-41fb-adb3-31928df63825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.707875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-752cc665-3b30-41fb-adb3-31928df63825 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:02.708985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-752cc665-3b30-41fb-adb3-31928df63825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:02.713653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.714532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.714968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.715396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.716321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:02.716847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.718481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.720168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.738247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 399/802] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:02.739352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.781883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 404/803] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:02.782553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cc665-3b30-41fb-adb3-31928df63825 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.818937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:02.869670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0128-01f4-4a87-82ec-356bddf1a2af None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.886731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cc665-3b30-41fb-adb3-31928df63825 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:02.906441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.907128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.907527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.907808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.908525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:02.908836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.910408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.920116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 400/804] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:02.920116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.926984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:02.928173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:02.928460 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:02.929052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:02.939901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:02.941923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:02.959814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:02.960891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:02.961835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:02.961835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:02.961835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:02.961835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:02.961835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 405/805] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:02.962145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:02.983928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:03.029125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e355ffd-6f80-4929-97e7-4e85f931f9c2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.055277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:03.071753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c49d1-338b-4757-bcb2-d9e8844cc2b5 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.072006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.072665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.072956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.073239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.081208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.082778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:03.098350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:03.099329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:03.100253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 401/806] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:03.100732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.117295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39cecc-8498-45ee-bc0c-b63ee8f24369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.118196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39cecc-8498-45ee-bc0c-b63ee8f24369 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.118491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39cecc-8498-45ee-bc0c-b63ee8f24369 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.118768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39cecc-8498-45ee-bc0c-b63ee8f24369 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.130612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39cecc-8498-45ee-bc0c-b63ee8f24369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-0e39cecc-8498-45ee-bc0c-b63ee8f24369 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:03.138628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:03.139575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 406/807] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:57:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:03.145731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39cecc-8498-45ee-bc0c-b63ee8f24369 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.209202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a434c-b27a-498e-bcd9-dee5f2601d0c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.226736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:03.245039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.245713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.246037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.246281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39cecc-8498-45ee-bc0c-b63ee8f24369 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.246386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.247034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:03.247348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.248765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.253760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 402/808] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 30 11:57:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:03.259112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.287052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.288659 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.289288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.289831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.290975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:03.291826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.293622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.311569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 407/809] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:03.312571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.327062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:03.364917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266d83b-6627-4d4f-8c1a-e6ae4019286c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.401690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.402490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.402773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.403049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.403830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:03.404136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.405710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.418373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 403/810] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:03.419158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.429154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb20ab-6251-4f3c-a15a-6bbcf8948d9f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.461266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:03.463134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.463798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.464095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.464370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.465109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:03.465416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.466815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.476073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:03.476999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.519691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef017e-314c-43cb-ab0b-6dad5bfeca87 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.543479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:03.552895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584a864-9585-4164-9acb-0a86a2029e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.556120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584a864-9585-4164-9acb-0a86a2029e4e None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.556120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584a864-9585-4164-9acb-0a86a2029e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.556120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584a864-9585-4164-9acb-0a86a2029e4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.556120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584a864-9585-4164-9acb-0a86a2029e4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.556422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584a864-9585-4164-9acb-0a86a2029e4e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.576378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68f350-4566-4db8-8144-a42eff0c698a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.610015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f163d-2a00-4ab7-80db-429ccfc06ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.610799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f163d-2a00-4ab7-80db-429ccfc06ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.611083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f163d-2a00-4ab7-80db-429ccfc06ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.611357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f163d-2a00-4ab7-80db-429ccfc06ff7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.618393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f163d-2a00-4ab7-80db-429ccfc06ff7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.619934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f163d-2a00-4ab7-80db-429ccfc06ff7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-087f163d-2a00-4ab7-80db-429ccfc06ff7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:03.634543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:03.635571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 409/812] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:03.636965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41bcf-5862-49a1-a86c-8f296a8116c8 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.637639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41bcf-5862-49a1-a86c-8f296a8116c8 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.637639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41bcf-5862-49a1-a86c-8f296a8116c8 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.638808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 410/813] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:03.642082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41bcf-5862-49a1-a86c-8f296a8116c8 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.646359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 404/814] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 11:57:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:03.646711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584a864-9585-4164-9acb-0a86a2029e4e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.764584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41bcf-5862-49a1-a86c-8f296a8116c8 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.771878 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:03.776824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584a864-9585-4164-9acb-0a86a2029e4e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:03.792014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:03.804363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8aada-7faf-4f0b-ad3b-016c76bada57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.805352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8aada-7faf-4f0b-ad3b-016c76bada57 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.805706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8aada-7faf-4f0b-ad3b-016c76bada57 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.806097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8aada-7faf-4f0b-ad3b-016c76bada57 None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/8eb03f76d840406ebe2365fd092d72f4/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.808310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8aada-7faf-4f0b-ad3b-016c76bada57 None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=8eb03f76d840406ebe2365fd092d72f4, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.809865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8aada-7faf-4f0b-ad3b-016c76bada57 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.817919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:03.818773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.819101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.819635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.831205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:03.834974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:03.850659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:03.851599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:03.852744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:03.852744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:03.852744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:03.852744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:03.852744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 405/815] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:03.852744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:03.918015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 411/816] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:57:03 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/8eb03f76d840406ebe2365fd092d72f4/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:57:03.919658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25413c23-e482-4272-98b6-23f5e252edea None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:03.920088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25413c23-e482-4272-98b6-23f5e252edea None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:03.920515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25413c23-e482-4272-98b6-23f5e252edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:03.948222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-25413c23-e482-4272-98b6-23f5e252edea None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:03.957797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-25413c23-e482-4272-98b6-23f5e252edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:03.969910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247076b-e3c9-417a-8475-82b5db4ac629 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.015414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.016344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.016792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.017211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.018261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:04.018729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.020360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:04.035338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 406/817] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:04.036540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:04.052805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:04.061995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 412/818] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:04.061995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25413c23-e482-4272-98b6-23f5e252edea None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:04.175766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e6b9-3946-40a6-b41c-06d6802503ff None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.202759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25413c23-e482-4272-98b6-23f5e252edea None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.218923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:04.224787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.225652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.226121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.232224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.232224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:04.232224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.232224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:04.241115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99980a6e-f814-471d-8959-e6cea6643349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.242177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99980a6e-f814-471d-8959-e6cea6643349 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.242528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99980a6e-f814-471d-8959-e6cea6643349 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.242872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99980a6e-f814-471d-8959-e6cea6643349 None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/987e7ae8a7a24af8b391474e711051b1/roles/aac7e705dfc84393a31372f43cedd793` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.244668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 407/819] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:04.245787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:04.262337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99980a6e-f814-471d-8959-e6cea6643349 None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=987e7ae8a7a24af8b391474e711051b1, role_id=aac7e705dfc84393a31372f43cedd793)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.263897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99980a6e-f814-471d-8959-e6cea6643349 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:04.322883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:04.353109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 413/820] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:57:04 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/987e7ae8a7a24af8b391474e711051b1/roles/aac7e705dfc84393a31372f43cedd793 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:57:04.358172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141637a-71c7-4034-a286-91909a7d6195 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.359537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99980a6e-f814-471d-8959-e6cea6643349 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:04.392775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.392775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.392775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.393742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] PATH_INFO: `/v3/services/network` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.394678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.396118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:04.408622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:04.410500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 30 11:57:04.411345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:04.418018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 408/821] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:04 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:04.419325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:04.534438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804a1c3-3570-4dd5-9d06-df0ac4229952 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.572315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.573150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.573493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.573879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.574729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:04.577356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.577356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:04.577825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:04.587655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99980a6e-f814-471d-8959-e6cea6643349 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.596694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 409/822] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:04.596694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:04.670772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.671722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.672013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.672296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.687224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.688818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:04.702432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91d30c-8550-4171-baab-2290cde648f8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:04.711495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:04.712474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:04.714115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 414/823] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:57:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:04.718716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:04.757230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:04.760192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.761076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.761544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.762060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.762964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] RBAC: Adding query filter params (type=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:04.763505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.765096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:04.776980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 410/824] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:04.779558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:04.882649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:04.912126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e923f-ce70-4da1-b2bd-9d05abad1ffe None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.920738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a44f-814e-48e1-9835-329dfc18b2df None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:04.961268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae014d64-a151-402e-8657-040b6f72c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.962356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014d64-a151-402e-8657-040b6f72c0f8 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.962855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014d64-a151-402e-8657-040b6f72c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.963472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014d64-a151-402e-8657-040b6f72c0f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.964419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae014d64-a151-402e-8657-040b6f72c0f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.966028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae014d64-a151-402e-8657-040b6f72c0f8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:04.989495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:04.990531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:04.991170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:04.991976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:04.994022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:04.994751 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:04.996794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:05.016611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 415/825] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:57:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:05.024269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:05.077747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 411/826] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 11:57:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:05.118784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:05.140045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc89d4-8cb8-48eb-9bfb-6231ebf8672b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:05.192546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4852d-d1e3-4536-ad03-8cc9be6efff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:05.193292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4852d-d1e3-4536-ad03-8cc9be6efff8 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.193578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4852d-d1e3-4536-ad03-8cc9be6efff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.193854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4852d-d1e3-4536-ad03-8cc9be6efff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.297485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4852d-d1e3-4536-ad03-8cc9be6efff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:05.300398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4852d-d1e3-4536-ad03-8cc9be6efff8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:05.382802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:05.407332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 416/827] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:57:05.412014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae014d64-a151-402e-8657-040b6f72c0f8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:05.525326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae014d64-a151-402e-8657-040b6f72c0f8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:05.546283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:05.566646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:05.567814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.568361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.568870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.582292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:05.585369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:05.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:05.604714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:05.605608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:05.605608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:05.605608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:05.605608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:05.607885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 412/828] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:05.618980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4852d-d1e3-4536-ad03-8cc9be6efff8 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:05.737410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4852d-d1e3-4536-ad03-8cc9be6efff8 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:05.780934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:05.782089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.782596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.783077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.784565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:05.785086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:05.786687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:05.798892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 417/829] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:05.807042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:05.916339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003463b5-fc36-4c49-a888-fa3085a77171 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:05.950723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:05.951525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:05.951812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:05.952089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:05.959584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:05.961055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:05.975917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:05.976787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:05.977731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 413/830] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:05.983755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:06.030349 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:06.087583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd79696-1654-4149-97a0-19506a09f2d2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:06.125548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd466e-c57c-407d-9664-6982c45e9160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:06.126703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd466e-c57c-407d-9664-6982c45e9160 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.127201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd466e-c57c-407d-9664-6982c45e9160 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.128216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd466e-c57c-407d-9664-6982c45e9160 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.129313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd466e-c57c-407d-9664-6982c45e9160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:06.129834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd466e-c57c-407d-9664-6982c45e9160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:06.131574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd466e-c57c-407d-9664-6982c45e9160 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:06.147330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 418/831] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:06.154003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:06.184552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:06.215156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414830-6e28-4b83-8dcc-2e232a46beba None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.215792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414830-6e28-4b83-8dcc-2e232a46beba None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.216289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414830-6e28-4b83-8dcc-2e232a46beba None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.218103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 419/832] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:06.228486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c95489-6d8c-4686-998f-9bbc1700878a None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.229101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c95489-6d8c-4686-998f-9bbc1700878a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.229586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c95489-6d8c-4686-998f-9bbc1700878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.250493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c4c95489-6d8c-4686-998f-9bbc1700878a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:06.253150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c4c95489-6d8c-4686-998f-9bbc1700878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:06.262312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f1247-711f-41ba-ab5b-e96994b2e004 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:06.305237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:06.305883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.306215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.306498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.307389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=7ca17dc23a924e41a657db3122445923) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:06.307707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:06.309598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:06.322008 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 414/833] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:06 2022] GET /identity/v3/role_assignments?user.id=7ca17dc23a924e41a657db3122445923&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=f3f138e4021a4b7dada39089dd427266 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:06.350419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 420/834] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:06.369894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:06.456954 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4cc60-0dda-44b6-ba5b-608c3a80798d None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.457249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4cc60-0dda-44b6-ba5b-608c3a80798d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.457532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4cc60-0dda-44b6-ba5b-608c3a80798d None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.459254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 421/835] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:06.465322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319fb7-6702-41a0-b97a-2902e5b29b44 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.465616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319fb7-6702-41a0-b97a-2902e5b29b44 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.465904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319fb7-6702-41a0-b97a-2902e5b29b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.485109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-78319fb7-6702-41a0-b97a-2902e5b29b44 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:06.486441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-78319fb7-6702-41a0-b97a-2902e5b29b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:06.487536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:06.495091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b02c7e-e1be-4c0b-8645-7d9aa34e89b8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:06.528802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:06.547840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:06.550983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.551284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.551585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.552756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:06.554805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:06.570467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:06.571448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:06.572283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:06.574984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 415/836] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:06.576726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 422/837] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:06.581016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:06.601127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78319fb7-6702-41a0-b97a-2902e5b29b44 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:06.702213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46476e94-5ce4-4b69-852c-e136f3c3c85f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:06.733764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78319fb7-6702-41a0-b97a-2902e5b29b44 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:06.753369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:06.754075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.754369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.754650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.755378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:06.756039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:06.757082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:06.766766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 416/838] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:06.767780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:06.790236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1759b-c772-4ed1-a296-89e6d918e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:06.791525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1759b-c772-4ed1-a296-89e6d918e18e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.792140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1759b-c772-4ed1-a296-89e6d918e18e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.792641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1759b-c772-4ed1-a296-89e6d918e18e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.796414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:06.806417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1759b-c772-4ed1-a296-89e6d918e18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-47f1759b-c772-4ed1-a296-89e6d918e18e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:06.814732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:06.815685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:06.816522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:06.819569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 423/839] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:57:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:06.825430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1759b-c772-4ed1-a296-89e6d918e18e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:06.846663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:06.882980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4790b5-9db2-46b5-b9e3-b45ba88b995d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:06.919217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fc37a-eeb1-4b19-ab57-a01497bc11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:06.920054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fc37a-eeb1-4b19-ab57-a01497bc11ef None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.920443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fc37a-eeb1-4b19-ab57-a01497bc11ef None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.920824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fc37a-eeb1-4b19-ab57-a01497bc11ef None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.921638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fc37a-eeb1-4b19-ab57-a01497bc11ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:06.922150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fc37a-eeb1-4b19-ab57-a01497bc11ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:06.923748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fc37a-eeb1-4b19-ab57-a01497bc11ef None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:06.934379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 417/840] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:06.936769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1759b-c772-4ed1-a296-89e6d918e18e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:06.976593 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6809fa3-186e-4f53-b9b4-f9954306c931 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.976891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6809fa3-186e-4f53-b9b4-f9954306c931 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.977192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6809fa3-186e-4f53-b9b4-f9954306c931 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.978639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:06.979491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.979953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.980379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.981292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:06.981752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:06.982755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 418/841] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:06.983535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:06.984479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341379-876f-4793-af91-3d506d905655 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:06.984773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341379-876f-4793-af91-3d506d905655 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:06.985056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341379-876f-4793-af91-3d506d905655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:06.994863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 424/842] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:07.000749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.004633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-01341379-876f-4793-af91-3d506d905655 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:07.006883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-01341379-876f-4793-af91-3d506d905655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:07.095002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:07.110477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 419/843] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:07.124420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5e43a-be0c-433d-b06a-475c79cd20e8 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.131903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341379-876f-4793-af91-3d506d905655 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.159432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:07.176721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.177534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.177826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.178251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.189847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:07.191441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:07.210063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:07.211030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:07.211952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:07.211952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:07.211952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:07.211952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:07.211952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 425/844] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:07.216766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.269587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341379-876f-4793-af91-3d506d905655 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.316512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cad4b-5236-4093-8717-5106ef39e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.317712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cad4b-5236-4093-8717-5106ef39e60e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.318385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cad4b-5236-4093-8717-5106ef39e60e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.318772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cad4b-5236-4093-8717-5106ef39e60e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.322119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a021f-c4f5-40ba-b532-f4c36b721166 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.333609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cad4b-5236-4093-8717-5106ef39e60e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ba1cad4b-5236-4093-8717-5106ef39e60e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:07.344429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:07.345604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:57:07.347263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:07.353982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 420/845] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:07.353982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cad4b-5236-4093-8717-5106ef39e60e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.359719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:07.364730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.365408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.365742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.367003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.367003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:07.368411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:07.369849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:07.385226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 426/846] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:07.390199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.467897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:07.499042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921bd5c-af51-4886-af9b-791cd951965e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.500264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cad4b-5236-4093-8717-5106ef39e60e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.539102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.540056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.540351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.540629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.546211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.547276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.547849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.548295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:07.548513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.549791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:07.549948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:07.550541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:07.552445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:07.562194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 421/847] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:07.570108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:07.571069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 30 11:57:07.572614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:07.573155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.573252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 427/848] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:07.573716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.642507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:07.682546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25122a-8469-4513-8db4-30bd0bf3b19e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.707400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1bdf0-fe0f-4eee-9389-2e40349445cc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.728509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.730053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.730567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.731040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.742063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:07.747084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:07.748770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:07.754746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.755674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.756159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.759880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.759880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:07.759880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:07.759880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:07.769185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:07.770183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:07.771087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:07.771087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:07.771087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:07.771087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:07.771087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 422/849] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:07.776017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.788207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 428/850] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:07.793599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:07.904011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf138fb-4809-4bbc-bba6-122fc42a810f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.919403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0b25b-f216-473c-9bc5-3f37bad75d50 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:07.934535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:07.945769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.946989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.947343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.949273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.949273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:07.949273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:07.951447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:07.961335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e2393-d3e0-4fc2-8a7e-1c49ecb43e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:07.962321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e2393-d3e0-4fc2-8a7e-1c49ecb43e1c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:07.962882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e2393-d3e0-4fc2-8a7e-1c49ecb43e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:07.963360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e2393-d3e0-4fc2-8a7e-1c49ecb43e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:07.967484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 423/851] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:07.974893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.032414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:08.039888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e2393-d3e0-4fc2-8a7e-1c49ecb43e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.041353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e2393-d3e0-4fc2-8a7e-1c49ecb43e1c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.103168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36a6e-7e3b-4326-9e61-a0fb927e0b18 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:08.156600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 429/852] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:57:08.158212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e2393-d3e0-4fc2-8a7e-1c49ecb43e1c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.159530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:08.160949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.161460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.162612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.173058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:08.178384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.180715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:08.203061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:08.204078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:08.205014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:08.212358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 424/853] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 11:57:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:08.215063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.274772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e2393-d3e0-4fc2-8a7e-1c49ecb43e1c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:08.321181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:08.322896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.323389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.323845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.337993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6916c-8b7e-4236-80e6-001d155dd4c9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:08.339200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.342032 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.351431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:08.366604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:08.370598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:08.371482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:08.371482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:08.371482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:08.371482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:08.373692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 430/854] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:08.375122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.381298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:08.382569 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.383054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.383579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.384675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:08.385199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.386926 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.412725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 425/855] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 30 11:57:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:08.414126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.469433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:08.514749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b76a3d-f54a-4b7f-8687-4e22d5dd1a09 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:08.532027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92039c-802d-452a-a985-799b356334a7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:08.560222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:08.561165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.561466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.561754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.562514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:08.562832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.564899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.569408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210607c-c174-43c3-8af2-6915c43ebe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:08.570661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210607c-c174-43c3-8af2-6915c43ebe70 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.571143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210607c-c174-43c3-8af2-6915c43ebe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.571612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210607c-c174-43c3-8af2-6915c43ebe70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.584061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 431/856] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:08.585372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.611234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:08.646892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210607c-c174-43c3-8af2-6915c43ebe70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.648636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210607c-c174-43c3-8af2-6915c43ebe70 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.691788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fb12f-7b07-4f1f-bc2a-dc39009e1179 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:08.718339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:08.731112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701ff9d-cb22-44d9-98fd-2e317f5f576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:08.737221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701ff9d-cb22-44d9-98fd-2e317f5f576b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.737221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701ff9d-cb22-44d9-98fd-2e317f5f576b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.737221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701ff9d-cb22-44d9-98fd-2e317f5f576b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.739920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701ff9d-cb22-44d9-98fd-2e317f5f576b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.741375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701ff9d-cb22-44d9-98fd-2e317f5f576b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-0701ff9d-cb22-44d9-98fd-2e317f5f576b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:08.760301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:08.761189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:08.762102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:08.762102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:08.762102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:08.762102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:08.762102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:08.762102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:08.762102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:08.762102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:08.763051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 426/858] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:57:08.763866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 432/858] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:08.764765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210607c-c174-43c3-8af2-6915c43ebe70 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.765611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29377-67d3-4a6d-8d7f-379b92cb5a07 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.765905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29377-67d3-4a6d-8d7f-379b92cb5a07 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.766214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29377-67d3-4a6d-8d7f-379b92cb5a07 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.767660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 433/859] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:08.770462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b29377-67d3-4a6d-8d7f-379b92cb5a07 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.837855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:08.872713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b29377-67d3-4a6d-8d7f-379b92cb5a07 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:08.873590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210607c-c174-43c3-8af2-6915c43ebe70 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:08.907378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4d05e-12fe-4c4a-9d34-877aee177da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:08.908044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4d05e-12fe-4c4a-9d34-877aee177da7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.908333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4d05e-12fe-4c4a-9d34-877aee177da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.909162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4d05e-12fe-4c4a-9d34-877aee177da7 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.909953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4d05e-12fe-4c4a-9d34-877aee177da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:08.910292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4d05e-12fe-4c4a-9d34-877aee177da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.911160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:08.911741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4d05e-12fe-4c4a-9d34-877aee177da7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.911948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.912233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.912510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.923138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:08.929487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 434/860] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:08.929628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:08.929744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd32e82-1f89-4399-aa33-0056d4d97d06 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:08.929744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd32e82-1f89-4399-aa33-0056d4d97d06 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:08.929744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd32e82-1f89-4399-aa33-0056d4d97d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:08.942702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ebd32e82-1f89-4399-aa33-0056d4d97d06 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:08.943824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ebd32e82-1f89-4399-aa33-0056d4d97d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:08.947413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:08.948338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:08.949219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:08.949219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:08.949219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:08.949219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:08.951479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 427/861] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:08.951479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:08.988696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:09.030042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 435/862] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:09.030042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd32e82-1f89-4399-aa33-0056d4d97d06 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:09.089548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3343e-8e23-4d65-a1d2-ccb9c985a67c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.112866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:09.126083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.126737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.127048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.127806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.128634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=8eb03f76d840406ebe2365fd092d72f4) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:09.128943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.130434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.136165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 428/863] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:08 2022] GET /identity/v3/role_assignments?user.id=8eb03f76d840406ebe2365fd092d72f4&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=f3f138e4021a4b7dada39089dd427266 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:09.136955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:09.151744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd32e82-1f89-4399-aa33-0056d4d97d06 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.193662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44171090-4130-4e36-88c1-94f921284670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.194969 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171090-4130-4e36-88c1-94f921284670 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.195409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171090-4130-4e36-88c1-94f921284670 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.195828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171090-4130-4e36-88c1-94f921284670 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.196927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44171090-4130-4e36-88c1-94f921284670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:09.197441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44171090-4130-4e36-88c1-94f921284670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.199264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44171090-4130-4e36-88c1-94f921284670 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.218126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 436/864] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:09.219458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44171090-4130-4e36-88c1-94f921284670 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:09.257796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a5c13-3744-459c-98a7-2db9801af20b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.270368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:09.295324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.296159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.296628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.296914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.297582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.299165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:09.312375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:09.313453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:09.314398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:09.319867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 429/865] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 30 11:57:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:09.320851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:09.339872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44171090-4130-4e36-88c1-94f921284670 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.376956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac474582-4d77-4463-9f0b-6d508fdfb172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.378905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474582-4d77-4463-9f0b-6d508fdfb172 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.378905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474582-4d77-4463-9f0b-6d508fdfb172 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.379100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac474582-4d77-4463-9f0b-6d508fdfb172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.379561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:09.386109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac474582-4d77-4463-9f0b-6d508fdfb172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.387547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac474582-4d77-4463-9f0b-6d508fdfb172 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-ac474582-4d77-4463-9f0b-6d508fdfb172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:09.402062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:09.407439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 437/866] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce1892-9057-4b4b-8da5-cf7a5fd14593 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.408357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce1892-9057-4b4b-8da5-cf7a5fd14593 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.409026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce1892-9057-4b4b-8da5-cf7a5fd14593 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.409026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 438/867] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:09.409168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce1892-9057-4b4b-8da5-cf7a5fd14593 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:09.446848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ecee0-633d-42d3-bd6c-15565fa9879f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.483444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dea1cc-cac1-49e7-818c-1b849fec1842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.484119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea1cc-cac1-49e7-818c-1b849fec1842 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.484408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea1cc-cac1-49e7-818c-1b849fec1842 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.484690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea1cc-cac1-49e7-818c-1b849fec1842 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.485398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dea1cc-cac1-49e7-818c-1b849fec1842 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:09.485711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dea1cc-cac1-49e7-818c-1b849fec1842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.487668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dea1cc-cac1-49e7-818c-1b849fec1842 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.496815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 430/868] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:09.496815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701843-0281-42b7-a968-328147bbece5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.496815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701843-0281-42b7-a968-328147bbece5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.496815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701843-0281-42b7-a968-328147bbece5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.511494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bb701843-0281-42b7-a968-328147bbece5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:09.512349 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:09.512675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bb701843-0281-42b7-a968-328147bbece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:09.522490 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce1892-9057-4b4b-8da5-cf7a5fd14593 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.558762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.559434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.559726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.560006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.560804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:09.561117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.562611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.576047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 439/869] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:09.576687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:09.589547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 431/870] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:09.599643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701843-0281-42b7-a968-328147bbece5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:09.649799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:09.681331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a074542-46ad-4917-ba29-0938b12755aa None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.711732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701843-0281-42b7-a968-328147bbece5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.718495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.719285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.719569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.719846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.720550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:09.721491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.723262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.740622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 440/871] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:09.740622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:09.758217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848876e-42fe-4e06-a610-a701c4383cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.758979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848876e-42fe-4e06-a610-a701c4383cfc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.759409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848876e-42fe-4e06-a610-a701c4383cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.759762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848876e-42fe-4e06-a610-a701c4383cfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.760705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848876e-42fe-4e06-a610-a701c4383cfc None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=987e7ae8a7a24af8b391474e711051b1) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:09.761144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848876e-42fe-4e06-a610-a701c4383cfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.762774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848876e-42fe-4e06-a610-a701c4383cfc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.766790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:09.770302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 432/872] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:09 2022] GET /identity/v3/role_assignments?user.id=987e7ae8a7a24af8b391474e711051b1&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:09.872328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1568-fe90-466e-b010-d9f4c96351f0 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:09.913423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ead4c-6fab-4397-aec2-d65e810a5b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:09.914352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ead4c-6fab-4397-aec2-d65e810a5b7a None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:09.914749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ead4c-6fab-4397-aec2-d65e810a5b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:09.915138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ead4c-6fab-4397-aec2-d65e810a5b7a None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:09.916009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ead4c-6fab-4397-aec2-d65e810a5b7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:09.917574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ead4c-6fab-4397-aec2-d65e810a5b7a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:09.981465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 441/873] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:57:09 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:11.482187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbb750-c333-4682-b698-e59ec6c23949 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:11.482700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbb750-c333-4682-b698-e59ec6c23949 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:11.482779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbb750-c333-4682-b698-e59ec6c23949 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:11.484391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 433/874] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:11.492264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2b64-46d0-475e-9fba-931c69dc6ae0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:11.492264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2b64-46d0-475e-9fba-931c69dc6ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:11.492264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a2b64-46d0-475e-9fba-931c69dc6ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:11.515314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ff6a2b64-46d0-475e-9fba-931c69dc6ae0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:11.516796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ff6a2b64-46d0-475e-9fba-931c69dc6ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:11.597944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 442/875] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:11.621082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbb750-c333-4682-b698-e59ec6c23949 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:11.728108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbb750-c333-4682-b698-e59ec6c23949 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:11.735977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:11.763854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:11.769590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:11.769590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:11.769590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:11.769590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:11.769590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:11.780054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:11.781044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:11.781875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 434/876] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:11.788251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2b64-46d0-475e-9fba-931c69dc6ae0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:11.790722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:11.892505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a2b64-46d0-475e-9fba-931c69dc6ae0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:11.931232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc2058-24aa-4349-bf9f-c1352cfffacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:11.932147 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2058-24aa-4349-bf9f-c1352cfffacb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:11.932601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2058-24aa-4349-bf9f-c1352cfffacb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:11.933033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2058-24aa-4349-bf9f-c1352cfffacb None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:11.933886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc2058-24aa-4349-bf9f-c1352cfffacb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:11.934379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc2058-24aa-4349-bf9f-c1352cfffacb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:11.935903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc2058-24aa-4349-bf9f-c1352cfffacb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:11.941175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 443/877] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:11.949984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:12.058431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948eef6-6f28-4ab3-a554-4230f8041caa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:12.097147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597e95c-7a0d-4391-ab8f-cb953945d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:12.097819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597e95c-7a0d-4391-ab8f-cb953945d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.098390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597e95c-7a0d-4391-ab8f-cb953945d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.098667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597e95c-7a0d-4391-ab8f-cb953945d7e7 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.099420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597e95c-7a0d-4391-ab8f-cb953945d7e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:12.099731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597e95c-7a0d-4391-ab8f-cb953945d7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:12.101115 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597e95c-7a0d-4391-ab8f-cb953945d7e7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:12.106162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 435/878] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:12.246142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6adc-c1a7-486e-8dd4-f0b27b4a3d81 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.246753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6adc-c1a7-486e-8dd4-f0b27b4a3d81 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.247218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6adc-c1a7-486e-8dd4-f0b27b4a3d81 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.249108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 444/879] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:12.255253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652eb4c-6b56-42cf-9580-ef12d557a815 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.255539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652eb4c-6b56-42cf-9580-ef12d557a815 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.255821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652eb4c-6b56-42cf-9580-ef12d557a815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.274625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d652eb4c-6b56-42cf-9580-ef12d557a815 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:12.275835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d652eb4c-6b56-42cf-9580-ef12d557a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:12.306564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:12.321559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fa4a6-73ea-471c-a06b-aae7b2abac90 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.321559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fa4a6-73ea-471c-a06b-aae7b2abac90 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.321559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fa4a6-73ea-471c-a06b-aae7b2abac90 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.322046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 445/880] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:12.327899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795ae77-4d2c-4a23-979e-5444f64b96a5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.328454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795ae77-4d2c-4a23-979e-5444f64b96a5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.328735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795ae77-4d2c-4a23-979e-5444f64b96a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.349069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-a795ae77-4d2c-4a23-979e-5444f64b96a5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:12.350273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a795ae77-4d2c-4a23-979e-5444f64b96a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:12.352199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 436/881] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:12.380407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652eb4c-6b56-42cf-9580-ef12d557a815 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:12.418255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:12.427612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 446/882] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:12.429624 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836053-f527-410a-a639-aa6228775a1b None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.429915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836053-f527-410a-a639-aa6228775a1b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.430249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836053-f527-410a-a639-aa6228775a1b None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.435692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 447/883] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:12.437878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df77b4-2539-4c0e-b220-70c8da47aad1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.438197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df77b4-2539-4c0e-b220-70c8da47aad1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.438478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df77b4-2539-4c0e-b220-70c8da47aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.465439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b6df77b4-2539-4c0e-b220-70c8da47aad1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:12.467012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b6df77b4-2539-4c0e-b220-70c8da47aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:12.497871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652eb4c-6b56-42cf-9580-ef12d557a815 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:12.534448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0460c5-c121-4fe2-8c75-7ee8fd62fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:12.535109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0460c5-c121-4fe2-8c75-7ee8fd62fe78 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.535392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0460c5-c121-4fe2-8c75-7ee8fd62fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.535669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0460c5-c121-4fe2-8c75-7ee8fd62fe78 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.542030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 448/884] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:12.542510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0460c5-c121-4fe2-8c75-7ee8fd62fe78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:12.542593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df77b4-2539-4c0e-b220-70c8da47aad1 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:12.542678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0460c5-c121-4fe2-8c75-7ee8fd62fe78 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:12.620491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 437/885] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:57:12 2022] POST /identity/v3/services => generated 269 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:57:12.621287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0460c5-c121-4fe2-8c75-7ee8fd62fe78 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:12.646191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df77b4-2539-4c0e-b220-70c8da47aad1 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:12.655284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:12.684255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:12.703715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d041267-18bc-436e-a385-0b694d943d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:12.704616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d041267-18bc-436e-a385-0b694d943d88 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.704890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d041267-18bc-436e-a385-0b694d943d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.705658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d041267-18bc-436e-a385-0b694d943d88 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.720150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d041267-18bc-436e-a385-0b694d943d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-4d041267-18bc-436e-a385-0b694d943d88 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:12.730924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:12.731943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:12.732775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 449/886] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 30 11:57:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:12.739837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d041267-18bc-436e-a385-0b694d943d88 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:12.756260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0460c5-c121-4fe2-8c75-7ee8fd62fe78 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:12.795993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:12.796735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.797022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.797331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.798048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:12.799567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:12.813315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:12.814435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:12.815958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 438/887] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:12.826083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:12.882307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d041267-18bc-436e-a385-0b694d943d88 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:12.930978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:12.932451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.933195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.933697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.935009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:12.936019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:12.938170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:12.942729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:12.951764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 450/888] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 30 11:57:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:12.957677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300998e-0d3d-46a2-b732-b174df35b7dd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:12.958725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:12.994076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:12.994859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:12.995212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:12.995612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:12.996386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:12.996748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:12.998454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.004238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 439/889] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:13.009624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:13.011402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:13.072757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075ccd-dd36-491e-aefb-978e3cb68eb7 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:13.110602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:13.112430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:13.112922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:13.113421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:13.114245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9cecd-ae72-4e20-a707-f857555cfff7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:13.125470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:13.127973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:13.147395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:13.148308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:13.149199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:13.149199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:13.149199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:13.149199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:13.149846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:13.150548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:13.150894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:13.151178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:13.151894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:13.152340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:13.157103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.157357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 451/890] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:13.158877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:13.162039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 440/891] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:13.164985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:13.185034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:13.278711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2271773-2758-4adf-a6cb-918c8fe75f75 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:13.281182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:13.287645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523391e3-0caf-4bdb-827d-d1466ca28c66 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:13.316779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:13.317822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:13.318417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:13.319171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:13.320230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] RBAC: Adding query filter params (interface=public, service_id=d442a106e8d747b38c8d6f285e7591da, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:13.320750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:13.322664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.325934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:13.326356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:13.326647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:13.326928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:13.327661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:13.328021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:13.329406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.334806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 441/892] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 30 11:57:13 2022] GET /identity/v3/endpoints?service_id=d442a106e8d747b38c8d6f285e7591da&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:13.336004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:13.347638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 452/893] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:13.349013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:13.423251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:13.444915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906b656-6099-4279-a247-4e4ecf090d81 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:13.461799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7cf92-6778-4e48-b6cf-9cc4f6d2ac44 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:13.481309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555daff6-783f-4690-96c2-6340f0b8cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:13.482903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555daff6-783f-4690-96c2-6340f0b8cbac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:13.483407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555daff6-783f-4690-96c2-6340f0b8cbac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:13.483893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555daff6-783f-4690-96c2-6340f0b8cbac None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:13.484812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555daff6-783f-4690-96c2-6340f0b8cbac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:13.487051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555daff6-783f-4690-96c2-6340f0b8cbac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.498708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 442/894] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 11:57:13 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:57:13.508931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:13.510210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:13.510707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:13.511196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:13.520484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:13.522522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:13.540393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:13.541416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:13.542835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:13.545732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 453/895] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 11:57:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:13.551829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555daff6-783f-4690-96c2-6340f0b8cbac None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:13.664700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555daff6-783f-4690-96c2-6340f0b8cbac None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:13.702554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:13.703588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:13.704125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:13.704622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:13.705701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:13.706248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:13.707911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.728056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 443/896] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 30 11:57:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:13.734691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:13.759782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:13.852273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca3b67-b636-4fc9-8a81-306b82fdd736 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:13.888791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf14aa-5ada-4296-9b9e-fc8a99d8a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:13.889888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf14aa-5ada-4296-9b9e-fc8a99d8a94e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:13.890446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf14aa-5ada-4296-9b9e-fc8a99d8a94e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:13.890978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf14aa-5ada-4296-9b9e-fc8a99d8a94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:13.962908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf14aa-5ada-4296-9b9e-fc8a99d8a94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:13.964685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf14aa-5ada-4296-9b9e-fc8a99d8a94e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:13.983054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:14.069869 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 454/897] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:13 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:57:14.075689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:14.078869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:14.184180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d2d19-e9ed-4fb6-a1dc-abb95cc84a00 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:14.219938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a7e62-53a9-4c18-a497-aa4986cdb83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:14.221385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a7e62-53a9-4c18-a497-aa4986cdb83d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.221678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a7e62-53a9-4c18-a497-aa4986cdb83d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.221975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a7e62-53a9-4c18-a497-aa4986cdb83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.232973 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a7e62-53a9-4c18-a497-aa4986cdb83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:14.234483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a7e62-53a9-4c18-a497-aa4986cdb83d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-881a7e62-53a9-4c18-a497-aa4986cdb83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:14.252831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:14.253831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:14.254756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:14.254756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:14.254756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:14.254756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:14.258085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 444/898] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:14.260107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf14aa-5ada-4296-9b9e-fc8a99d8a94e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:14.364587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf14aa-5ada-4296-9b9e-fc8a99d8a94e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:14.382429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:14.401065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:14.401737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.404863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.404863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.404863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:14.404863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:14.405170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed009-99f4-4755-a4ce-0a6936c5a243 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.405170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed009-99f4-4755-a4ce-0a6936c5a243 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.405170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed009-99f4-4755-a4ce-0a6936c5a243 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.405366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:14.406013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 445/899] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:14.411307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4505aff-ed77-48c5-b9f7-3bde8e97125e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.411590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4505aff-ed77-48c5-b9f7-3bde8e97125e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.411861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4505aff-ed77-48c5-b9f7-3bde8e97125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.417265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 455/900] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:14.426991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:14.429199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f4505aff-ed77-48c5-b9f7-3bde8e97125e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:14.430394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f4505aff-ed77-48c5-b9f7-3bde8e97125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:14.504031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:14.528701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 446/901] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:14.541753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d617fc-335f-4e1e-afa1-d8f646854439 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:14.552287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4505aff-ed77-48c5-b9f7-3bde8e97125e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:14.584451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:14.585394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.585691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.585987 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.594547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:14.596718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:14.615616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:14.617632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:14.619840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:14.619840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:14.619840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:14.619840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:14.619840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:14.619840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:14.619840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:14.619840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:14.626009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 456/902] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:14.626009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:14.665445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:14.675977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4505aff-ed77-48c5-b9f7-3bde8e97125e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:14.720023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70556c4-5678-4265-be14-228589c176d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:14.721114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70556c4-5678-4265-be14-228589c176d6 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.721544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70556c4-5678-4265-be14-228589c176d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.722018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70556c4-5678-4265-be14-228589c176d6 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.722937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70556c4-5678-4265-be14-228589c176d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:14.724551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70556c4-5678-4265-be14-228589c176d6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:14.743135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e95c-4dec-4250-98c4-6785ccffd71d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:14.781692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6f7c-e7a9-4cd1-a3ca-8ae89b7e4832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:14.782334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6f7c-e7a9-4cd1-a3ca-8ae89b7e4832 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.782617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6f7c-e7a9-4cd1-a3ca-8ae89b7e4832 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.782889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6f7c-e7a9-4cd1-a3ca-8ae89b7e4832 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.783743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e6f7c-e7a9-4cd1-a3ca-8ae89b7e4832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:14.784047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e6f7c-e7a9-4cd1-a3ca-8ae89b7e4832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:14.785524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e6f7c-e7a9-4cd1-a3ca-8ae89b7e4832 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:14.797500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 447/903] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:57:14 2022] POST /identity/v3/services => generated 241 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:57:14.808233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 457/904] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:14.815140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70556c4-5678-4265-be14-228589c176d6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:14.869013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:14.942002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70556c4-5678-4265-be14-228589c176d6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:14.981513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed462320-12fc-4d04-8e16-bde50eb52616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:14.982530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462320-12fc-4d04-8e16-bde50eb52616 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.982970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462320-12fc-4d04-8e16-bde50eb52616 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.983402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed462320-12fc-4d04-8e16-bde50eb52616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.984426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462320-12fc-4d04-8e16-bde50eb52616 None admin] RBAC: Adding query filter params (role.id=265b98d926324dd3abf543dcfd662462, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=987e7ae8a7a24af8b391474e711051b1) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:14.984907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462320-12fc-4d04-8e16-bde50eb52616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:14.987152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed462320-12fc-4d04-8e16-bde50eb52616 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:14.991262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca17869-7f30-4fde-8f56-932dea216c95 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:14.992356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca17869-7f30-4fde-8f56-932dea216c95 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:14.993210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca17869-7f30-4fde-8f56-932dea216c95 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:14.995101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 448/905] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:14 2022] GET /identity/v3/role_assignments?user.id=987e7ae8a7a24af8b391474e711051b1&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=265b98d926324dd3abf543dcfd662462 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:14.995507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 458/906] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:15.001041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104462c-3a2a-461e-b9cd-68651be28e69 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:15.001389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104462c-3a2a-461e-b9cd-68651be28e69 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:15.001583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104462c-3a2a-461e-b9cd-68651be28e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:15.020589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2104462c-3a2a-461e-b9cd-68651be28e69 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:15.021833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2104462c-3a2a-461e-b9cd-68651be28e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:15.105277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 449/907] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:15.128993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca17869-7f30-4fde-8f56-932dea216c95 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:15.241979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:15.248114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca17869-7f30-4fde-8f56-932dea216c95 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:15.283017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:15.284359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:15.284639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:15.284912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:15.285563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:15.286971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:15.300168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:15.301144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:15.302278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 459/908] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 30 11:57:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:15.307483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104462c-3a2a-461e-b9cd-68651be28e69 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:15.342900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:15.417498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104462c-3a2a-461e-b9cd-68651be28e69 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:15.455620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:15.456298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:15.456588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:15.456870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:15.457588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:15.457900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:15.459326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:15.465012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 450/909] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:15.470431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:15.582216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8be8d-375a-43a4-b220-b34f1e5c2df6 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:15.618241 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:15.618888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:15.619185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:15.619469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:15.620184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:15.620495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:15.621882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:15.627551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 460/910] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:15.635065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:15.744717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:15.748870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd7d1-80de-484a-90ad-179280076196 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:15.784999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2276ad-2dc6-4a20-aea4-c03fcfdac10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:15.785904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2276ad-2dc6-4a20-aea4-c03fcfdac10c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:15.786274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2276ad-2dc6-4a20-aea4-c03fcfdac10c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:15.786860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2276ad-2dc6-4a20-aea4-c03fcfdac10c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:15.787654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2276ad-2dc6-4a20-aea4-c03fcfdac10c None admin] RBAC: Adding query filter params (interface=public, service_id=8cb16cc591a14c6c8368ff7c4b5a2dac, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:15.787963 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2276ad-2dc6-4a20-aea4-c03fcfdac10c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:15.789338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2276ad-2dc6-4a20-aea4-c03fcfdac10c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:15.794873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 451/911] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 30 11:57:15 2022] GET /identity/v3/endpoints?service_id=8cb16cc591a14c6c8368ff7c4b5a2dac&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:15.800045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:15.827980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:15.886623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fe3f-9be5-4750-beef-41a366c2e1fa None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:15.887254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fe3f-9be5-4750-beef-41a366c2e1fa None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:15.887753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fe3f-9be5-4750-beef-41a366c2e1fa None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:15.889576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 452/912] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:15.894789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852b33-c0d6-403a-8a1c-a907ea5ba3c3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:15.895080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852b33-c0d6-403a-8a1c-a907ea5ba3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:15.895360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852b33-c0d6-403a-8a1c-a907ea5ba3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:15.912830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85756b17-0fad-4bbe-a5fb-20a7bd759515 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:15.918854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d3852b33-c0d6-403a-8a1c-a907ea5ba3c3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:15.920773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d3852b33-c0d6-403a-8a1c-a907ea5ba3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:15.957934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997533-616d-4237-8c8a-7dc54186a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:15.958860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997533-616d-4237-8c8a-7dc54186a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:15.959316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997533-616d-4237-8c8a-7dc54186a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:15.959755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1997533-616d-4237-8c8a-7dc54186a2e1 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:15.960704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1997533-616d-4237-8c8a-7dc54186a2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:15.962412 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1997533-616d-4237-8c8a-7dc54186a2e1 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:15.969244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 461/913] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 11:57:15 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:57:15.996188 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 453/914] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:16.022633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997533-616d-4237-8c8a-7dc54186a2e1 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:16.130366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:16.139724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1997533-616d-4237-8c8a-7dc54186a2e1 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:16.179089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:16.180310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:16.180807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:16.181358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:16.182350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:16.184084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:16.198530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:16.199793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 30 11:57:16.200824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:16.203520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 462/915] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:16.209798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3852b33-c0d6-403a-8a1c-a907ea5ba3c3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:16.311776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:16.326216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3852b33-c0d6-403a-8a1c-a907ea5ba3c3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:16.361722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:16.362427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:16.362711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:16.362988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:16.363693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:16.363997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:16.365394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:16.370648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 454/916] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:16.375921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:16.482896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57faf98-b4a8-49c6-bc03-16e27fa99863 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:16.518167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058bceb-f816-41d9-bca4-3be4f88dd647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:16.518832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058bceb-f816-41d9-bca4-3be4f88dd647 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:16.519122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058bceb-f816-41d9-bca4-3be4f88dd647 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:16.519400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058bceb-f816-41d9-bca4-3be4f88dd647 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:16.520098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058bceb-f816-41d9-bca4-3be4f88dd647 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:16.520404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058bceb-f816-41d9-bca4-3be4f88dd647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:16.521771 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058bceb-f816-41d9-bca4-3be4f88dd647 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:16.527037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 463/917] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 30 11:57:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:16.532567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:16.639112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858463a-bff0-478d-8f8c-be79b36580eb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:16.674724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4258a4-1691-4119-91c7-3efeea5e713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:16.675392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4258a4-1691-4119-91c7-3efeea5e713d None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:16.675675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4258a4-1691-4119-91c7-3efeea5e713d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:16.675952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4258a4-1691-4119-91c7-3efeea5e713d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:16.676706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4258a4-1691-4119-91c7-3efeea5e713d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:16.678117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4258a4-1691-4119-91c7-3efeea5e713d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:16.755789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 455/918] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 11:57:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:17.292605 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b59855-c2c8-4dc8-a74b-e8d9fb1b7da4 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.293619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b59855-c2c8-4dc8-a74b-e8d9fb1b7da4 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.294169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b59855-c2c8-4dc8-a74b-e8d9fb1b7da4 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.296049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 464/919] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:17.302133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44bcd4-bd95-4bf2-9ea0-6eec4f66c775 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.302682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44bcd4-bd95-4bf2-9ea0-6eec4f66c775 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.303173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44bcd4-bd95-4bf2-9ea0-6eec4f66c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.321253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bb44bcd4-bd95-4bf2-9ea0-6eec4f66c775 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:17.322465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bb44bcd4-bd95-4bf2-9ea0-6eec4f66c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:17.330712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:17.386254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe904de-8702-49c4-a764-74166c547baa None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.386596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe904de-8702-49c4-a764-74166c547baa None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.386852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe904de-8702-49c4-a764-74166c547baa None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.389469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 465/920] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:17.394263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111659e-a9d1-4bfb-ae47-b067389b107b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.394583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111659e-a9d1-4bfb-ae47-b067389b107b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.394870 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111659e-a9d1-4bfb-ae47-b067389b107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.397626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 456/921] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:17.416702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0111659e-a9d1-4bfb-ae47-b067389b107b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:17.417879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0111659e-a9d1-4bfb-ae47-b067389b107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:17.420508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44bcd4-bd95-4bf2-9ea0-6eec4f66c775 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:17.431887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:17.514012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 466/922] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:17.538899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111659e-a9d1-4bfb-ae47-b067389b107b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:17.545810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44bcd4-bd95-4bf2-9ea0-6eec4f66c775 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:17.590955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:17.591935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.592224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.592506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.593521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:17.595008 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:17.610245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:17.611815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:17.612641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:17.615647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 457/923] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:17.622328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:17.626235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:17.658267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111659e-a9d1-4bfb-ae47-b067389b107b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:17.697138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a43fe-3775-40b5-babb-d317c245f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:17.698571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a43fe-3775-40b5-babb-d317c245f236 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.699087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a43fe-3775-40b5-babb-d317c245f236 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.699694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a43fe-3775-40b5-babb-d317c245f236 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.711271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a43fe-3775-40b5-babb-d317c245f236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-1c2a43fe-3775-40b5-babb-d317c245f236 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:17.720363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:17.721432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:17.722281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:17.725150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 467/924] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 30 11:57:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:17.736786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a43fe-3775-40b5-babb-d317c245f236 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:17.747472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:17.760424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb6832-580b-477c-98c0-55f3baa056bb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:17.805389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:17.806531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.807075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.807579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.808496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:17.809013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:17.810765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:17.816628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 458/925] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:17.822428 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:17.863468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a43fe-3775-40b5-babb-d317c245f236 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:17.894391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:17.905750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:17.907072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.907379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.910163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.910163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:17.910163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:17.911291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:17.926127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 468/926] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 30 11:57:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:17.931463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:17.943116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508c3b1-b608-43d2-9498-9848becc17cc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:17.983816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:17.984487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:17.984772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:17.985053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:17.985771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:17.986140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:17.987529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:17.992880 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 459/927] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:17.999438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.028967 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:18.055307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5817c69-910a-4374-b7d0-50aa8e59e454 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.092315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.093328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.093720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.094135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.105775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.107527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.124809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616036ee-275a-466b-aad6-13be0d8b1e48 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:18.128947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:18.129848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:18.131060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:18.131060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:18.131060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:18.131060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:18.133297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 469/928] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:18.144174 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.160049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:18.166414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.167488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.168033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.168521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.169686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] RBAC: Adding query filter params (interface=public, service_id=6508970a5bd34e3a8d85a3808333c3f2, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:18.170329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.177195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.178033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 460/929] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 30 11:57:17 2022] GET /identity/v3/endpoints?service_id=6508970a5bd34e3a8d85a3808333c3f2&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:18.185845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.280986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fedf13-ac92-4387-9c67-1dbb861a47aa None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.295937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941e344-4ea4-4545-ae6e-0a1cb406601d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.305336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:18.321281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6fbb8-aeba-414d-adfe-377aadc3b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.321943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6fbb8-aeba-414d-adfe-377aadc3b59b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.322263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6fbb8-aeba-414d-adfe-377aadc3b59b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.322543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6fbb8-aeba-414d-adfe-377aadc3b59b None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.323266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6fbb8-aeba-414d-adfe-377aadc3b59b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:18.323575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6fbb8-aeba-414d-adfe-377aadc3b59b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.324958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6fbb8-aeba-414d-adfe-377aadc3b59b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.331482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d7eb5-4598-4295-a50a-9b8af5c56688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.332149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d7eb5-4598-4295-a50a-9b8af5c56688 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.332922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d7eb5-4598-4295-a50a-9b8af5c56688 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.332922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d7eb5-4598-4295-a50a-9b8af5c56688 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.333437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d7eb5-4598-4295-a50a-9b8af5c56688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.334986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d7eb5-4598-4295-a50a-9b8af5c56688 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.338318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 470/930] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:18.339525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89927f-bd9c-406b-871f-9d30d8855f86 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.339813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89927f-bd9c-406b-871f-9d30d8855f86 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.340090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89927f-bd9c-406b-871f-9d30d8855f86 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.341438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 471/931] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:18.354240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 461/932] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:57:18.354424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d23f-6821-4a7a-b2a0-c889c14ec751 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.354525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d7eb5-4598-4295-a50a-9b8af5c56688 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.354601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d23f-6821-4a7a-b2a0-c889c14ec751 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.354601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d23f-6821-4a7a-b2a0-c889c14ec751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.376507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5664d23f-6821-4a7a-b2a0-c889c14ec751 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:18.378351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5664d23f-6821-4a7a-b2a0-c889c14ec751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:18.422052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:18.474119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 472/933] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:18.478780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d7eb5-4598-4295-a50a-9b8af5c56688 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.496980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d23f-6821-4a7a-b2a0-c889c14ec751 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.521491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.522770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.523295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.523767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.532723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.534629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:18.551111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:18.552126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:18.553070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:18.555743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 462/934] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:18.562419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.634432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d23f-6821-4a7a-b2a0-c889c14ec751 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.650347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:18.677278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.678162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.678460 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.678736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.679394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.680773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.685106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117167d-0c97-4787-987d-6e237a7e91fd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:18.694703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:18.695654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:18.696497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 473/935] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:18.705838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:18.706884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.726300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.726991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.727301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.727546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.728390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:18.728701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.730244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.755734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 463/936] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:18.758561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.851832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d519006-50a1-4408-b5ca-a29ef391570c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.879472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95718b-3598-4350-8dfb-cf3ebe062e03 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:18.891468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.892526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.893134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.893621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.894660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:18.895188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.896934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.903255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 474/937] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:18.909307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:18.924250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:18.925474 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:18.926073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:18.926363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:18.940388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:18.942431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:18.957179 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:18.967860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:18.975429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:18.976544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:18.976544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:18.976544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:18.976544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:18.976544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 464/938] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:18.978852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:19.019285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:19.035774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5448a-4294-4302-812e-a3021d3733ce None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.079358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8f7a5-1473-46a4-a5e1-3a855ae775a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.080201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f7a5-1473-46a4-a5e1-3a855ae775a6 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.080551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f7a5-1473-46a4-a5e1-3a855ae775a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.080904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f7a5-1473-46a4-a5e1-3a855ae775a6 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.082050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8f7a5-1473-46a4-a5e1-3a855ae775a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:19.082359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8f7a5-1473-46a4-a5e1-3a855ae775a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.084108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8f7a5-1473-46a4-a5e1-3a855ae775a6 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:19.094114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 475/939] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:19.096136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002ab0-198b-492e-b7a0-f5048fca561b None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.096434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002ab0-198b-492e-b7a0-f5048fca561b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.096717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002ab0-198b-492e-b7a0-f5048fca561b None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.098193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 476/940] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:19.098820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d002ab0-198b-492e-b7a0-f5048fca561b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:19.117475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac2b8d-28d6-4def-9168-442484fc78c3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.157492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d1c1c-ce93-40d2-81ff-f8ebb3d051c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.159121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1c1c-ce93-40d2-81ff-f8ebb3d051c5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.159600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1c1c-ce93-40d2-81ff-f8ebb3d051c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.160074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d1c1c-ce93-40d2-81ff-f8ebb3d051c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.160809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d1c1c-ce93-40d2-81ff-f8ebb3d051c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:19.161123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d1c1c-ce93-40d2-81ff-f8ebb3d051c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.162540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d1c1c-ce93-40d2-81ff-f8ebb3d051c5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:19.178978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 465/941] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:19.178978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d1cb-bacb-4ab3-b917-cd75f705c996 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.178978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d1cb-bacb-4ab3-b917-cd75f705c996 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.178978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d1cb-bacb-4ab3-b917-cd75f705c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.196531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fff6d1cb-bacb-4ab3-b917-cd75f705c996 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:19.197746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fff6d1cb-bacb-4ab3-b917-cd75f705c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:19.215849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d002ab0-198b-492e-b7a0-f5048fca561b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.217560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:19.254123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42e29f-9092-479d-9d31-2967b6f5ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.254794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e29f-9092-479d-9d31-2967b6f5ce86 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.255082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e29f-9092-479d-9d31-2967b6f5ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.255362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42e29f-9092-479d-9d31-2967b6f5ce86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.256118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42e29f-9092-479d-9d31-2967b6f5ce86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.257494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42e29f-9092-479d-9d31-2967b6f5ce86 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:19.270613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 466/942] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:19.271458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d1cb-bacb-4ab3-b917-cd75f705c996 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:19.300496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:19.349988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 477/943] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 11:57:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:19.349988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42e29f-9092-479d-9d31-2967b6f5ce86 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:19.398465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d1cb-bacb-4ab3-b917-cd75f705c996 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.442699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.443787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.444072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.444347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.452157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.453642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:19.471662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:19.472624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:19.473509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 467/944] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:19.479098 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:19.489566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42e29f-9092-479d-9d31-2967b6f5ce86 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.543425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.544111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.544402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.544684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.545405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.546906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:19.548307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING keystone.server.flask.common [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 30 11:57:19.577005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:19.597063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.sql.core [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 30 11:57:19.597063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 30 11:57:19.597063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [parameters: {'id': '2b9c258d8fd34571b1e0891882eaaa5e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 30 11:57:19.597063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80343) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 30 11:57:19.605255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aa091-a090-4072-9f20-c2fc16307c1e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b9c258d8fd34571b1e0891882eaaa5e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b9c258d8fd34571b1e0891882eaaa5e. May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application conn.query(q) May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:57:19.606905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result.read() May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 30 11:57:19.608221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return project_ref.to_dict() May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application next(self.gen) May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application yield resource May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application next(self.gen) May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.session.rollback() May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.force_reraise() May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise self.value May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application session.commit() May 30 11:57:19.609169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._prepare_impl() May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.session.flush() May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._flush(objects) May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application compat.raise_( May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application flush_context.execute() May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 30 11:57:19.610173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rec.execute(self) May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application _emit_insert_statements( May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application c = connection._execute_20( May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ret = self._execute_context( May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 30 11:57:19.611120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application conn.query(q) May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result.read() May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:57:19.611946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [parameters: {'id': '2b9c258d8fd34571b1e0891882eaaa5e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:19.612813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:19.613598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.Conflict( May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2b9c258d8fd34571b1e0891882eaaa5e. May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 478/945] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 30 11:57:19 2022] POST /identity/v3/projects => generated 262 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:19.616183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:19.646876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:19.661759 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.662720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.663007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.663290 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.664141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:19.664605 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.666898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:19.686521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 468/946] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:19.694071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:19.761109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923395-955c-4b2b-9578-3ebe94fcfe3e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.797567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.798156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.798821 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.799291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.807651 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.809290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:19.824654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa4ef6-14ee-4fd1-88c7-5e13cef4f610 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:19.825101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:19.826196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:19.827191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:19.827191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:19.827191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:19.827191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:19.827191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:19.827191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:19.827191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:19.827191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:19.831675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 479/947] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:19.832631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:19.872849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f7dc8-8b87-49b6-a583-e1c348f98f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.874036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7dc8-8b87-49b6-a583-e1c348f98f17 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.874458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7dc8-8b87-49b6-a583-e1c348f98f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.875367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7dc8-8b87-49b6-a583-e1c348f98f17 None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/987e7ae8a7a24af8b391474e711051b1/roles/265b98d926324dd3abf543dcfd662462` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.878858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f7dc8-8b87-49b6-a583-e1c348f98f17 None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=987e7ae8a7a24af8b391474e711051b1, role_id=265b98d926324dd3abf543dcfd662462)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.881216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f7dc8-8b87-49b6-a583-e1c348f98f17 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:19.885094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:19.913003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:19.943288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bd256-71ed-433c-a441-50556e9d92fc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:19.962185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 469/948] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:57:19 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/987e7ae8a7a24af8b391474e711051b1/roles/265b98d926324dd3abf543dcfd662462 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:57:19.991035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50205fc1-c3af-4ff7-81b3-6cef249665cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:19.991978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205fc1-c3af-4ff7-81b3-6cef249665cb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:19.992435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205fc1-c3af-4ff7-81b3-6cef249665cb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:19.992867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50205fc1-c3af-4ff7-81b3-6cef249665cb None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:19.993798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205fc1-c3af-4ff7-81b3-6cef249665cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:19.994284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205fc1-c3af-4ff7-81b3-6cef249665cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:19.995977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50205fc1-c3af-4ff7-81b3-6cef249665cb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:20.020617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 480/949] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:20.695821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5cd08-0df4-4578-9677-f422434c1e20 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:20.696210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5cd08-0df4-4578-9677-f422434c1e20 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:20.696389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5cd08-0df4-4578-9677-f422434c1e20 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:20.698064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 470/950] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:20.703654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4de552-401a-4985-80a5-607a908738c0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:20.704085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4de552-401a-4985-80a5-607a908738c0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:20.704256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4de552-401a-4985-80a5-607a908738c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:20.722539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8f4de552-401a-4985-80a5-607a908738c0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:20.724063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8f4de552-401a-4985-80a5-607a908738c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:20.798071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 481/951] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:20.817050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5cd08-0df4-4578-9677-f422434c1e20 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:20.928894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5cd08-0df4-4578-9677-f422434c1e20 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:20.965292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:20.966413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:20.966906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:20.967395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:20.968246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:20.969808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:20.982841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:20.983946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:20.984842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:20.987804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 471/952] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:20.993742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4de552-401a-4985-80a5-607a908738c0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:21.058212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:21.096482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4de552-401a-4985-80a5-607a908738c0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:21.134088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:21.134765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:21.135055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:21.135330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:21.136042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:21.136347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:21.137745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:21.143828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 482/953] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:21.151115 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:21.218770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:21.261819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7651b3-21c0-48f3-b7ff-df5f9fbf8143 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:21.297178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a5cec-8606-40b4-b441-81563d3626b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:21.297835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5cec-8606-40b4-b441-81563d3626b1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:21.298150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5cec-8606-40b4-b441-81563d3626b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:21.298454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5cec-8606-40b4-b441-81563d3626b1 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:21.299166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a5cec-8606-40b4-b441-81563d3626b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:21.299475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a5cec-8606-40b4-b441-81563d3626b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:21.300849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a5cec-8606-40b4-b441-81563d3626b1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:21.307227 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 472/954] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:21.312953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:21.419883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be188b58-f6d8-4c6c-9f18-4a87eac04beb None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:21.459190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4ae11-0177-4524-8fa4-5d0975fb1a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:21.459864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ae11-0177-4524-8fa4-5d0975fb1a28 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:21.460157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ae11-0177-4524-8fa4-5d0975fb1a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:21.460443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4ae11-0177-4524-8fa4-5d0975fb1a28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:21.461212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4ae11-0177-4524-8fa4-5d0975fb1a28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:21.462623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4ae11-0177-4524-8fa4-5d0975fb1a28 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:21.464675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:21.553056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 483/955] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 11:57:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:21.770322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96902c-8878-4e3c-995f-2d3d6d65e0a1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:21.770623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96902c-8878-4e3c-995f-2d3d6d65e0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:21.770891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96902c-8878-4e3c-995f-2d3d6d65e0a1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:21.772276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 473/956] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:21.777671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad6826-6b14-422e-88ee-9f4e8cfa37a6 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:21.778257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad6826-6b14-422e-88ee-9f4e8cfa37a6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:21.778257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad6826-6b14-422e-88ee-9f4e8cfa37a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:21.795814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-95ad6826-6b14-422e-88ee-9f4e8cfa37a6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:21.797011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-95ad6826-6b14-422e-88ee-9f4e8cfa37a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:21.873639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 484/957] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:21.895177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96902c-8878-4e3c-995f-2d3d6d65e0a1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.012978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96902c-8878-4e3c-995f-2d3d6d65e0a1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:22.039132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:22.052777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:22.059463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.059463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.059463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.059463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:22.059463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:22.069738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:22.070825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:22.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 474/958] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:22.077033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad6826-6b14-422e-88ee-9f4e8cfa37a6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.186078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad6826-6b14-422e-88ee-9f4e8cfa37a6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:22.197582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:22.222650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1ebb-7dd8-4e12-965d-4d4f9f9a54db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:22.223322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1ebb-7dd8-4e12-965d-4d4f9f9a54db None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.223610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1ebb-7dd8-4e12-965d-4d4f9f9a54db None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.223890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1ebb-7dd8-4e12-965d-4d4f9f9a54db None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.224602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c1ebb-7dd8-4e12-965d-4d4f9f9a54db None admin] RBAC: Adding query filter params (name=compute) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:22.224909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c1ebb-7dd8-4e12-965d-4d4f9f9a54db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:22.226307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c1ebb-7dd8-4e12-965d-4d4f9f9a54db None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:22.231999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 485/959] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:22.237568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.343583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04126a8-b2dc-43f3-81b3-42c789b06971 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:22.373338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead789-a0b5-4688-b495-aa38121af2ad None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.373626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead789-a0b5-4688-b495-aa38121af2ad None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.373902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bead789-a0b5-4688-b495-aa38121af2ad None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.375327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 486/960] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:22.379921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a61a6-5f11-41f5-a7f5-a376115ca228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:22.380269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d46347-01e9-4ab2-bd3d-2ad92f28163d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.380564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d46347-01e9-4ab2-bd3d-2ad92f28163d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.380672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a61a6-5f11-41f5-a7f5-a376115ca228 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.380863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d46347-01e9-4ab2-bd3d-2ad92f28163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.380970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a61a6-5f11-41f5-a7f5-a376115ca228 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.381121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a61a6-5f11-41f5-a7f5-a376115ca228 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.381839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a61a6-5f11-41f5-a7f5-a376115ca228 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:22.382276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a61a6-5f11-41f5-a7f5-a376115ca228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:22.383876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a61a6-5f11-41f5-a7f5-a376115ca228 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:22.389298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 475/961] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:22.390600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc927e9-81ca-48a3-829b-8ffc8bf94cac None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.390891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc927e9-81ca-48a3-829b-8ffc8bf94cac None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.391174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc927e9-81ca-48a3-829b-8ffc8bf94cac None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.393898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 476/962] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:22.398577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-49d46347-01e9-4ab2-bd3d-2ad92f28163d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:22.399800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-49d46347-01e9-4ab2-bd3d-2ad92f28163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:22.405124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e09a-95f7-4aac-aa0b-4ddad50e87cc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.405423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e09a-95f7-4aac-aa0b-4ddad50e87cc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.405676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e09a-95f7-4aac-aa0b-4ddad50e87cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.430096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2374e09a-95f7-4aac-aa0b-4ddad50e87cc None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:22.431640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2374e09a-95f7-4aac-aa0b-4ddad50e87cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:22.482075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 487/963] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:22.497822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:22.508587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d46347-01e9-4ab2-bd3d-2ad92f28163d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.526850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 477/964] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:22.551573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374e09a-95f7-4aac-aa0b-4ddad50e87cc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.634399 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d46347-01e9-4ab2-bd3d-2ad92f28163d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:22.637344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:22.669655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:22.670837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.672039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.672384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.673393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:22.675003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:22.694037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374e09a-95f7-4aac-aa0b-4ddad50e87cc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:22.723426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.sql.core [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 30 11:57:22.723426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 30 11:57:22.723426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [parameters: {'user_id': 'b6aa71ba9bd7497f895ad81dfb6f71dc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 30 11:57:22.723426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80343) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application conn.query(q) May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result.read() May 30 11:57:22.734519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:57:22.735443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application next(self.gen) May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application yield resource May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application next(self.gen) May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.session.rollback() May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.force_reraise() May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise self.value May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application session.commit() May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 30 11:57:22.736461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._prepare_impl() May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.session.flush() May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._flush(objects) May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application compat.raise_( May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application flush_context.execute() May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rec.execute(self) May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 30 11:57:22.737379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application _emit_insert_statements( May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result = connection._execute_20( May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ret = self._execute_context( May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 30 11:57:22.738335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self.dialect.do_execute( May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result = self._query(query) May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application conn.query(q) May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application result.read() May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 30 11:57:22.739227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application packet.raise_for_error() May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b6aa71ba9bd7497f895ad81dfb6f71dc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:22.740081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 30 11:57:22.740937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 30 11:57:22.743542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 30 11:57:22.743542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 30 11:57:22.743542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 30 11:57:22.743542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 30 11:57:22.743542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 30 11:57:22.743542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:22.744462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cc78e-f6d8-4205-9fdb-e0cfa378e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:22.744462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc78e-f6d8-4205-9fdb-e0cfa378e7cb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.744462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc78e-f6d8-4205-9fdb-e0cfa378e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.744462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc78e-f6d8-4205-9fdb-e0cfa378e7cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.745485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 488/965] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 30 11:57:22 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:22.754626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.758109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cc78e-f6d8-4205-9fdb-e0cfa378e7cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-621cc78e-f6d8-4205-9fdb-e0cfa378e7cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:22.769994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:22.770965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:22.771824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:22.774192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 478/966] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 30 11:57:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:22.780778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cc78e-f6d8-4205-9fdb-e0cfa378e7cb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.825482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:22.877486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621fed7-5eda-4ef0-bcd8-f29992c0050f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:22.887416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cc78e-f6d8-4205-9fdb-e0cfa378e7cb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:22.915528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:22.916802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.917282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.917776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.924837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:22.925574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:22.925870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:22.926186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:22.926944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:22.927274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:22.928453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:22.928646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:22.930602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:22.942570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 479/967] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 30 11:57:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:22.944144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:22.947493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:22.948552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 30 11:57:22.949511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:22.956593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 489/968] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:57:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:22.957912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:22.989015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:23.047876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a88bfc-ba3d-4d32-8255-805a15f6a4d6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:23.050195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:23.069446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cb5d-6890-4520-84e3-2803b8a31895 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:23.085304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:23.086142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:23.086434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:23.086750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:23.098554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:23.100804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:23.107745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:23.108783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:23.109265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:23.109738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:23.111362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:23.111868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:23.113551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:23.120221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:23.121181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:23.122112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:23.122112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:23.122112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:23.122112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:23.126055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 480/969] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:23.128148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:23.163619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 490/970] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 30 11:57:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:23.241928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1c9a8-7138-4852-b790-1b592ff326aa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:23.279767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:23.280434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:23.280726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:23.281013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:23.281749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:23.282104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:23.284037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:23.302168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 481/971] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:23.304132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:23.399191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:23.416562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c12a-ac7f-41d7-bc8a-793fa6bfb407 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:23.453383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:23.454239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:23.454567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:23.454846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:23.462544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:23.464034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:23.479972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:23.480980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:23.482249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 491/972] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 11:57:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:23.488188 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:23.506249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:23.598361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce03e2-4dd0-4b71-8723-a33598de808f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:23.632916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691315c-dc05-4b4b-bd34-e071c006b15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:23.633590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691315c-dc05-4b4b-bd34-e071c006b15c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:23.633876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691315c-dc05-4b4b-bd34-e071c006b15c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:23.634183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691315c-dc05-4b4b-bd34-e071c006b15c None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:23.635028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691315c-dc05-4b4b-bd34-e071c006b15c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:23.635344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691315c-dc05-4b4b-bd34-e071c006b15c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:23.636785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691315c-dc05-4b4b-bd34-e071c006b15c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:23.660961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 482/973] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 30 11:57:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:23.666417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:23.775141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eebc0d-cbb7-447c-b2ad-351cd59246f4 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:23.811192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa216a0-6b7b-4bfc-88fc-7b1e1375cbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:23.812213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa216a0-6b7b-4bfc-88fc-7b1e1375cbdc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:23.812750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa216a0-6b7b-4bfc-88fc-7b1e1375cbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:23.813238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa216a0-6b7b-4bfc-88fc-7b1e1375cbdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:23.829289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:23.883260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa216a0-6b7b-4bfc-88fc-7b1e1375cbdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:23.884722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa216a0-6b7b-4bfc-88fc-7b1e1375cbdc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:23.896957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f991-7bdf-42b3-a9e4-6bb26910598f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:23.897248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f991-7bdf-42b3-a9e4-6bb26910598f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:23.897529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f991-7bdf-42b3-a9e4-6bb26910598f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:23.899090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 483/974] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:23.904743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae2344-2a78-44fd-a242-840a9fa7160c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:23.905035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae2344-2a78-44fd-a242-840a9fa7160c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:23.905314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae2344-2a78-44fd-a242-840a9fa7160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:23.922214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a6ae2344-2a78-44fd-a242-840a9fa7160c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:23.923411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a6ae2344-2a78-44fd-a242-840a9fa7160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:23.991987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 484/975] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:23.993868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 492/976] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:23 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:57:23.994993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae2344-2a78-44fd-a242-840a9fa7160c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:23.997446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:24.015124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa216a0-6b7b-4bfc-88fc-7b1e1375cbdc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.065108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:24.097175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae2344-2a78-44fd-a242-840a9fa7160c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.125192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa216a0-6b7b-4bfc-88fc-7b1e1375cbdc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.133661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.134715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.135196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.136064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.147280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.149013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.160518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.161322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.161612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.161894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.162585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.164000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:24.168888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:24.172231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:24.173121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:24.173121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:24.173121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:24.173121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:24.174307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 485/977] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:24.175971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:24.176196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:24.177501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:24.178464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 493/978] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:24.183577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.240478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:24.286515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc199d2-b6d2-4ae5-8906-9ff1a1fb9fc2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.294229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e2b05-0db2-41df-a874-eae29607a272 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.303694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:24.322407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.323002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.323284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.323557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.324275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:24.324580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.326114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.331370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.332092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.332791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.334021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.335704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:24.336055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.337497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.338832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 486/979] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:24.344446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.346026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 494/980] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:24.350326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.453475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6b28e-2c1b-4734-9318-1f886f38242c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.461502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e88c7-ebd7-468a-a54d-27e7cfa3d277 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.467728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:24.487740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.488537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.488833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.489113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.495926 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.497394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.497521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.498066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.498427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.498704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.499410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:24.499713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.501076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.507154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 495/981] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:24.512803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:24.513991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:24.514835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:24.515925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 487/982] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:24.522855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.551554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:24.616090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207656c-4b29-4416-b972-5aee67d58ad2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.630428 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc1a3-8c06-432f-8c98-e179a6ebd856 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.651226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.651882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.652162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.652434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.653221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] RBAC: Adding query filter params (interface=admin, service_id=6508970a5bd34e3a8d85a3808333c3f2, region_id=RegionOne) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:24.653530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.654922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.662745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 496/983] 10.222.0.48 () {56 vars in 1249 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/endpoints?service_id=6508970a5bd34e3a8d85a3808333c3f2&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:24.665614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63a1eb-016d-4c5b-bc68-74d4c47c8cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.666538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a1eb-016d-4c5b-bc68-74d4c47c8cdf None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.667010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a1eb-016d-4c5b-bc68-74d4c47c8cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.667470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a1eb-016d-4c5b-bc68-74d4c47c8cdf None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.667830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.668643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63a1eb-016d-4c5b-bc68-74d4c47c8cdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:24.669153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63a1eb-016d-4c5b-bc68-74d4c47c8cdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.670799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63a1eb-016d-4c5b-bc68-74d4c47c8cdf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.683317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 488/984] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:24.684854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44250-ca49-44df-8c13-9a085ef57e1e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.685221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44250-ca49-44df-8c13-9a085ef57e1e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.685505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44250-ca49-44df-8c13-9a085ef57e1e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.686893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 489/985] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:24.692166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176696c-6ce7-4be1-a4b9-86e37299d7ba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.692518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176696c-6ce7-4be1-a4b9-86e37299d7ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.692803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176696c-6ce7-4be1-a4b9-86e37299d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.710084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0176696c-6ce7-4be1-a4b9-86e37299d7ba None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:24.711269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0176696c-6ce7-4be1-a4b9-86e37299d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:24.738799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:24.769791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:24.772708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842b523-b6bb-4e80-b59d-dbdd9388dbe2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.777309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 490/986] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:24.778197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176696c-6ce7-4be1-a4b9-86e37299d7ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.806516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeefdd1-8800-42a4-8bd8-1f543b4a8628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.807207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeefdd1-8800-42a4-8bd8-1f543b4a8628 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.807493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeefdd1-8800-42a4-8bd8-1f543b4a8628 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.814487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeefdd1-8800-42a4-8bd8-1f543b4a8628 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.814487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeefdd1-8800-42a4-8bd8-1f543b4a8628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.814487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeefdd1-8800-42a4-8bd8-1f543b4a8628 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.824136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 497/987] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 11:57:24.824136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeefdd1-8800-42a4-8bd8-1f543b4a8628 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:24.896812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176696c-6ce7-4be1-a4b9-86e37299d7ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.932086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeefdd1-8800-42a4-8bd8-1f543b4a8628 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:24.934874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74808c7-40af-4c8c-bd12-0df9d450ee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.935500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74808c7-40af-4c8c-bd12-0df9d450ee5f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.935784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74808c7-40af-4c8c-bd12-0df9d450ee5f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.936061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74808c7-40af-4c8c-bd12-0df9d450ee5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.936906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74808c7-40af-4c8c-bd12-0df9d450ee5f None admin] RBAC: Adding query filter params (role.id=265b98d926324dd3abf543dcfd662462, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=987e7ae8a7a24af8b391474e711051b1) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:24.937220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74808c7-40af-4c8c-bd12-0df9d450ee5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.938765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74808c7-40af-4c8c-bd12-0df9d450ee5f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:24.945880 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 491/988] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:24 2022] GET /identity/v3/role_assignments?user.id=987e7ae8a7a24af8b391474e711051b1&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=265b98d926324dd3abf543dcfd662462 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:24.976897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26006bb-c7cb-4a0f-8110-5acb87d05cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:24.977594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26006bb-c7cb-4a0f-8110-5acb87d05cf3 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:24.977880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26006bb-c7cb-4a0f-8110-5acb87d05cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:24.978196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26006bb-c7cb-4a0f-8110-5acb87d05cf3 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:24.978966 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26006bb-c7cb-4a0f-8110-5acb87d05cf3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:24.980430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26006bb-c7cb-4a0f-8110-5acb87d05cf3 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:25.066573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 498/989] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:57:24 2022] POST /identity/v3/services => generated 242 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:27.106493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe560d-fad9-40a1-9ee5-189dabd7017f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.106996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe560d-fad9-40a1-9ee5-189dabd7017f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.106996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe560d-fad9-40a1-9ee5-189dabd7017f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.108517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 492/990] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:27.113692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84e3a-5b75-4db5-8d65-fed6d5653593 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.114115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84e3a-5b75-4db5-8d65-fed6d5653593 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.114307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84e3a-5b75-4db5-8d65-fed6d5653593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.131822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ede84e3a-5b75-4db5-8d65-fed6d5653593 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:27.141233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ede84e3a-5b75-4db5-8d65-fed6d5653593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:27.152416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.213744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 499/991] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:27.229541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f1af6-2398-4482-ad54-ccdae4d3e4ef None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.229840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f1af6-2398-4482-ad54-ccdae4d3e4ef None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.230141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f1af6-2398-4482-ad54-ccdae4d3e4ef None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.231678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 493/992] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:27.236535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f1af6-2398-4482-ad54-ccdae4d3e4ef None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.236798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f052-46ce-44d5-bcd4-e1aef93d1f5c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.237103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f052-46ce-44d5-bcd4-e1aef93d1f5c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.237390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f052-46ce-44d5-bcd4-e1aef93d1f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.256987 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-6f90f052-46ce-44d5-bcd4-e1aef93d1f5c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:27.258224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6f90f052-46ce-44d5-bcd4-e1aef93d1f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:27.267796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.330367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 500/993] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:27.336985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce7df-6e90-4845-a744-21171a584330 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.337284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce7df-6e90-4845-a744-21171a584330 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.337612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce7df-6e90-4845-a744-21171a584330 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.339111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 501/994] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:27.343844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eebfd-de31-4b13-b954-fe71eebe2b72 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.344133 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eebfd-de31-4b13-b954-fe71eebe2b72 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.344416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eebfd-de31-4b13-b954-fe71eebe2b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.352086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f1af6-2398-4482-ad54-ccdae4d3e4ef None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:27.361329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-cb4eebfd-de31-4b13-b954-fe71eebe2b72 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:27.362501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cb4eebfd-de31-4b13-b954-fe71eebe2b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:27.386861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:27.387658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.387941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.388218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.388860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:27.390248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:27.402277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:27.403475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 30 11:57:27.404609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.408448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 494/995] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 30 11:57:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:27.409264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.431213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 502/996] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:27.432052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eebfd-de31-4b13-b954-fe71eebe2b72 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.444123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.506891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.515062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a652-ef61-4b0b-bc80-371fad0dcfa5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:27.528826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eebfd-de31-4b13-b954-fe71eebe2b72 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:27.547549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:27.548858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.549138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.549415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.550080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:27.551445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:27.562659 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:27.562815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:27.564508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:27.565936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.566731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.566731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.566873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 495/997] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 30 11:57:27 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:27.566952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.567024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.567093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:27.567093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:27.567093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:27.579175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 503/998] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:27.579175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.647406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.666535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2597-ee32-428e-a731-ccbe9d5694a2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:27.671375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00ea53-6e7e-40f0-8dc9-7c68964774b8 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:27.702245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:27.703030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.703316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.703589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.704258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:27.705623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:27.707937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:27.708592 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.708875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.709151 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.709846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] RBAC: Adding query filter params (name=image) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:27.710182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:27.711529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:27.716253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 504/999] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:27.717014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:27.717522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:27.718532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:27.722774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 496/1000] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:27.723590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.747761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.821542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6257b00-32b5-4cf3-bad6-ee8bf6146f04 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:27.822173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0993be-3da1-4c10-8fac-9f20d5dc917b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:27.854875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:27.855269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:27.855533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.855818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.855930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:27.856095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.856221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:27.856507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:27.856793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] RBAC: Adding query filter params (type=image) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:27.857100 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:27.857211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:27.857523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:27.858544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:27.858971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:27.863622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 497/1001] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:27.864397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.871056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 505/1002] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 30 11:57:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:27.880188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:27.884005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.960412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:27.980037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96678d0a-65a1-48ee-a6b8-9c7e76c16437 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:28.005266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e9dd0-52e9-40e5-92b6-7dae6dc9e7b2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:28.020055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:28.021026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:28.021484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:28.021767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:28.022531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:28.022846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:28.024265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:28.034770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 498/1003] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:28.035938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:28.047682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922f83-a21d-400f-a189-68df59e98aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:28.048931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922f83-a21d-400f-a189-68df59e98aa0 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:28.049218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922f83-a21d-400f-a189-68df59e98aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:28.049495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922f83-a21d-400f-a189-68df59e98aa0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:28.050281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97922f83-a21d-400f-a189-68df59e98aa0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:28.051662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97922f83-a21d-400f-a189-68df59e98aa0 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:28.105801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 506/1004] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 11:57:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:57:28.147242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ce9e3-1ae4-41c6-aef5-2b70c839a044 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:28.191262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:28.191943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:28.192230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:28.192509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:28.193541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:28.193854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:28.195427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:28.206039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 499/1005] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:28.207778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922f83-a21d-400f-a189-68df59e98aa0 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:28.274882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:28.318351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922f83-a21d-400f-a189-68df59e98aa0 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:28.355945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b0426-25a8-45a9-a687-38ae3e865963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:28.356622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b0426-25a8-45a9-a687-38ae3e865963 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:28.356911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b0426-25a8-45a9-a687-38ae3e865963 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:28.357189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b0426-25a8-45a9-a687-38ae3e865963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:28.358045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b0426-25a8-45a9-a687-38ae3e865963 None admin] RBAC: Adding query filter params (interface=public, service_id=41c050b86b6542288f77884971dc7a49, region_id=RegionOne) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:28.358320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b0426-25a8-45a9-a687-38ae3e865963 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:28.359696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b0426-25a8-45a9-a687-38ae3e865963 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:28.365318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 507/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 30 11:57:28 2022] GET /identity/v3/endpoints?service_id=41c050b86b6542288f77884971dc7a49&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:28.370999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:28.383351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:28.475807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06506d-0405-4bd6-baec-763152eb1dfd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:28.509830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f235a2-6907-4c7f-8147-835b2eb36a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:28.510528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f235a2-6907-4c7f-8147-835b2eb36a35 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:28.510814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f235a2-6907-4c7f-8147-835b2eb36a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:28.511090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f235a2-6907-4c7f-8147-835b2eb36a35 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:28.511771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f235a2-6907-4c7f-8147-835b2eb36a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:28.513134 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f235a2-6907-4c7f-8147-835b2eb36a35 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:28.526151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 500/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 11:57:28 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:57:30.140773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943f415-2be4-4511-9695-683e5dcba888 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.141305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943f415-2be4-4511-9695-683e5dcba888 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.141305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943f415-2be4-4511-9695-683e5dcba888 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.143247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 508/1008] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:30.148669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a778-fbb1-4530-b264-cc3285418ec6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.149048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a778-fbb1-4530-b264-cc3285418ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.149335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a778-fbb1-4530-b264-cc3285418ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.166451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6454a778-fbb1-4530-b264-cc3285418ec6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:30.167655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6454a778-fbb1-4530-b264-cc3285418ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:30.237538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 501/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:30.260445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943f415-2be4-4511-9695-683e5dcba888 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:30.363624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2376c0-3db8-43b2-8a41-3536dacb3986 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.363918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2376c0-3db8-43b2-8a41-3536dacb3986 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.364194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2376c0-3db8-43b2-8a41-3536dacb3986 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.365707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 502/1010] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:30.369935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943f415-2be4-4511-9695-683e5dcba888 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:30.370406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3f73-a681-47f4-ba21-2c6ad1ea360d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.370692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3f73-a681-47f4-ba21-2c6ad1ea360d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.370971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3f73-a681-47f4-ba21-2c6ad1ea360d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.376665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:30.389256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-10de3f73-a681-47f4-ba21-2c6ad1ea360d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:30.390737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-10de3f73-a681-47f4-ba21-2c6ad1ea360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:30.397440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:30.407319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595b1bc-5e26-412b-860c-c6022196f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:30.407988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595b1bc-5e26-412b-860c-c6022196f094 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.408272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595b1bc-5e26-412b-860c-c6022196f094 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.408558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595b1bc-5e26-412b-860c-c6022196f094 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.409509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595b1bc-5e26-412b-860c-c6022196f094 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:30.410860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595b1bc-5e26-412b-860c-c6022196f094 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:30.461809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 503/1011] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:30.472022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 509/1012] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:57:30 2022] POST /identity/v3/services => generated 242 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:30.486990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de3f73-a681-47f4-ba21-2c6ad1ea360d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:30.597067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de3f73-a681-47f4-ba21-2c6ad1ea360d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:30.629321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:30.641517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc75ac-fdf2-443b-ac86-b934b44c08c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:30.642427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc75ac-fdf2-443b-ac86-b934b44c08c5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.642771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc75ac-fdf2-443b-ac86-b934b44c08c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.643186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc75ac-fdf2-443b-ac86-b934b44c08c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.644487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc75ac-fdf2-443b-ac86-b934b44c08c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:30.646079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc75ac-fdf2-443b-ac86-b934b44c08c5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:30.648100 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 504/1013] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:30.653884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595b1bc-5e26-412b-860c-c6022196f094 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:30.770040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595b1bc-5e26-412b-860c-c6022196f094 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:30.805401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efd5a9-0b8b-4756-a880-1605b6c425dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:30.807270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19e89-7ff6-4e5d-b33a-f81b66343d38 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.807562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19e89-7ff6-4e5d-b33a-f81b66343d38 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.807852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19e89-7ff6-4e5d-b33a-f81b66343d38 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.809225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 505/1014] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:30.809640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efd5a9-0b8b-4756-a880-1605b6c425dd None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.809933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efd5a9-0b8b-4756-a880-1605b6c425dd None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.810239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efd5a9-0b8b-4756-a880-1605b6c425dd None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.810961 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efd5a9-0b8b-4756-a880-1605b6c425dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:30.812407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efd5a9-0b8b-4756-a880-1605b6c425dd None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:30.814240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2aebf-9eed-485a-81fd-0149ab669a99 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:30.814616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2aebf-9eed-485a-81fd-0149ab669a99 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:30.814907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2aebf-9eed-485a-81fd-0149ab669a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:30.833506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1bc2aebf-9eed-485a-81fd-0149ab669a99 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:30.834720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1bc2aebf-9eed-485a-81fd-0149ab669a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:30.914072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 506/1015] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:30.914277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 510/1016] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:57:30 2022] POST /identity/v3/projects => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:57:30.930681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2aebf-9eed-485a-81fd-0149ab669a99 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:31.042602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2aebf-9eed-485a-81fd-0149ab669a99 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:31.075172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:31.084760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:31.085577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:31.085860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:31.086161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:31.086824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:31.088233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:31.101452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:31.102708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:31.103691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 507/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:31.108575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efd5a9-0b8b-4756-a880-1605b6c425dd None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:31.151557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:31.214360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efd5a9-0b8b-4756-a880-1605b6c425dd None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:31.248298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:31.248966 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:31.249249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:31.249524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:31.250252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:31.250557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:31.252045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:31.257076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 511/1018] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:31.263028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:31.369261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09bf8-a91e-410b-bc2e-a4b598d66d9d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:31.403119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a56b1d-978d-4148-969d-5817ba676a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:31.403778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a56b1d-978d-4148-969d-5817ba676a1d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:31.404061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a56b1d-978d-4148-969d-5817ba676a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:31.404337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a56b1d-978d-4148-969d-5817ba676a1d None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:31.405039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a56b1d-978d-4148-969d-5817ba676a1d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:31.405343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a56b1d-978d-4148-969d-5817ba676a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:31.406933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a56b1d-978d-4148-969d-5817ba676a1d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:31.414297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 508/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 30 11:57:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:31.421353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:31.524374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb00fd2-e9c0-4f71-99fa-1488e13a4716 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:31.525901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:31.559034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717e9aa-7a3c-469b-af16-ca773334d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:31.559034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e9aa-7a3c-469b-af16-ca773334d1e9 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:31.559439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e9aa-7a3c-469b-af16-ca773334d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:31.559629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e9aa-7a3c-469b-af16-ca773334d1e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:31.560334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717e9aa-7a3c-469b-af16-ca773334d1e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:31.561686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717e9aa-7a3c-469b-af16-ca773334d1e9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:31.642082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 512/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 11:57:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:57:32.747730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16173a2-f856-4691-a806-8a192a7542c4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:32.748234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16173a2-f856-4691-a806-8a192a7542c4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:32.748313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16173a2-f856-4691-a806-8a192a7542c4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:32.750061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 509/1021] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:32.755478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8c82-a0da-4fe3-8513-33ca2816380c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:32.755885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8c82-a0da-4fe3-8513-33ca2816380c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:32.756078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8c82-a0da-4fe3-8513-33ca2816380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:32.772995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-12ff8c82-a0da-4fe3-8513-33ca2816380c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:32.774200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-12ff8c82-a0da-4fe3-8513-33ca2816380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:32.851107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 513/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:32.873547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16173a2-f856-4691-a806-8a192a7542c4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:32.936878 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:32.983306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16173a2-f856-4691-a806-8a192a7542c4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:33.017911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:33.018653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.018938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.019213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] PATH_INFO: `/v3/services/image` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.019862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:33.021231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:33.032742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:33.033740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:33.034623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:33.038291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 510/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 30 11:57:32 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:33.040069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff8c82-a0da-4fe3-8513-33ca2816380c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:33.125288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:33.140971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff8c82-a0da-4fe3-8513-33ca2816380c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:33.176023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19eca8f-5748-44c8-95bd-3124188b7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:33.176693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eca8f-5748-44c8-95bd-3124188b7ffa None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.176983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eca8f-5748-44c8-95bd-3124188b7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.177264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eca8f-5748-44c8-95bd-3124188b7ffa None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.177985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eca8f-5748-44c8-95bd-3124188b7ffa None admin] RBAC: Adding query filter params (name=image) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:33.178313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eca8f-5748-44c8-95bd-3124188b7ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:33.179693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eca8f-5748-44c8-95bd-3124188b7ffa None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:33.189877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 514/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:33.190975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:33.250268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57596e-851a-4452-b21c-165720825a84 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.250558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57596e-851a-4452-b21c-165720825a84 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.251362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57596e-851a-4452-b21c-165720825a84 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.252878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 515/1025] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:33.257779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b0c5c-ade5-4dff-984f-ad2fd8e228a7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.258102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b0c5c-ade5-4dff-984f-ad2fd8e228a7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.258388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b0c5c-ade5-4dff-984f-ad2fd8e228a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.275260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-128b0c5c-ade5-4dff-984f-ad2fd8e228a7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:33.276364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-128b0c5c-ade5-4dff-984f-ad2fd8e228a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:33.295128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3fe66-6594-4a3f-8048-208b7bd47e73 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:33.314471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:33.332930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:33.333623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.334060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.334344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.335174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] RBAC: Adding query filter params (type=image) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:33.335489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:33.336978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:33.342963 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 511/1026] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:33.345700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 516/1027] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:33.351141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:33.370921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b0c5c-ade5-4dff-984f-ad2fd8e228a7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:33.455581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:33.456830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95a61a-14e4-47af-87c3-3d28b00e8bce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:33.478078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b0c5c-ade5-4dff-984f-ad2fd8e228a7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:33.497446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:33.498140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.498420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.498701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.499480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] RBAC: Adding query filter params (interface=public, service_id=7cb615c2671f45539e3c64161b191c33, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:33.499798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:33.501744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:33.506871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 512/1028] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 30 11:57:33 2022] GET /identity/v3/endpoints?service_id=7cb615c2671f45539e3c64161b191c33&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:33.512363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:33.515597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5537c-50db-4772-b16f-99687f8d7ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:33.516621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5537c-50db-4772-b16f-99687f8d7ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.516760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5537c-50db-4772-b16f-99687f8d7ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.517056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5537c-50db-4772-b16f-99687f8d7ed9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.518290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5537c-50db-4772-b16f-99687f8d7ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:33.519725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5537c-50db-4772-b16f-99687f8d7ed9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:33.521693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 517/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:33.527344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5537c-50db-4772-b16f-99687f8d7ed9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:33.561142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:33.619322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817b9ff-ffb8-4389-ab7e-3d7d48dec878 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:33.641893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5537c-50db-4772-b16f-99687f8d7ed9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:33.657804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b482a-e9e6-4ea5-92f2-a248a46b08ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:33.658661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b482a-e9e6-4ea5-92f2-a248a46b08ef None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.659353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b482a-e9e6-4ea5-92f2-a248a46b08ef None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.659353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b482a-e9e6-4ea5-92f2-a248a46b08ef None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.659966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b482a-e9e6-4ea5-92f2-a248a46b08ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:33.661394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b482a-e9e6-4ea5-92f2-a248a46b08ef None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:33.677989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 513/1030] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 11:57:33 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 11:57:33.692385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1921e-1dbf-45f6-a572-1d96ffaf85af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:33.693434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1921e-1dbf-45f6-a572-1d96ffaf85af None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.693813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1921e-1dbf-45f6-a572-1d96ffaf85af None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.694194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1921e-1dbf-45f6-a572-1d96ffaf85af None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.695008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1921e-1dbf-45f6-a572-1d96ffaf85af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:33.696578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1921e-1dbf-45f6-a572-1d96ffaf85af None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:33.782548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 518/1031] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:57:33 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:57:33.979908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bc68c-5f5e-4e52-8859-02012e3564dd None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.980418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bc68c-5f5e-4e52-8859-02012e3564dd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.980533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bc68c-5f5e-4e52-8859-02012e3564dd None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.981835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 514/1032] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:33.988144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288541-cb13-45a8-a69b-33215ddea207 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:33.988444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288541-cb13-45a8-a69b-33215ddea207 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:33.988730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288541-cb13-45a8-a69b-33215ddea207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:33.993997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:34.006040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2a288541-cb13-45a8-a69b-33215ddea207 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:34.007265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2a288541-cb13-45a8-a69b-33215ddea207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:34.077642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 519/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:34.100969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bc68c-5f5e-4e52-8859-02012e3564dd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:34.206583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bc68c-5f5e-4e52-8859-02012e3564dd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:34.217331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:34.241494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0588d-173c-416c-a532-acc89fd240e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:34.242332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0588d-173c-416c-a532-acc89fd240e0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:34.242615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0588d-173c-416c-a532-acc89fd240e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:34.242888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0588d-173c-416c-a532-acc89fd240e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:34.254207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0588d-173c-416c-a532-acc89fd240e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e5f0588d-173c-416c-a532-acc89fd240e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:34.262350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:34.263265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:34.264141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:34.266036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 515/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 30 11:57:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:34.270276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288541-cb13-45a8-a69b-33215ddea207 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:34.371194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288541-cb13-45a8-a69b-33215ddea207 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:34.400559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:34.406178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:34.407480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:34.407819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:34.408105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:34.408870 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:34.409180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:34.410608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:34.423852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 520/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 30 11:57:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:34.425303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0588d-173c-416c-a532-acc89fd240e0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:34.525726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0588d-173c-416c-a532-acc89fd240e0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:34.558817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:34.559609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:34.559891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:34.560165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:34.570917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:34.572372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:34.590257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:34.591475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:34.592432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:34.592432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:34.592432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:34.592432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:34.592432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 516/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:34.598475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:34.697742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0b93-f23d-4111-9165-6578355f6904 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:34.732561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:34.733574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:34.733859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:34.734170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:34.734891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:34.735195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:34.736555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:34.752712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 521/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:34.758046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:34.783095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:34.859225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8dac6-ae15-43c2-a0f6-e75ef252f2b6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:34.894834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:34.895625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:34.895907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:34.896182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:34.903479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:34.904919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:34.919184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:34.920130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:57:34.921085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:34.922326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 517/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:57:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:34.926616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:34.986481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:35.033524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46e84-4ff2-4158-b624-e37ae9a1ac81 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:35.068169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:35.068835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:35.069116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:35.069390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:35.070243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:35.070550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:35.071971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:35.093178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 522/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:57:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:35.094890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:35.179218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:35.198333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0be4c-3b4e-4570-9275-144211636a80 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:35.233052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2b2d1-55ef-41c6-bc91-3a595eab4b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:35.233700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2b2d1-55ef-41c6-bc91-3a595eab4b61 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:35.234006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2b2d1-55ef-41c6-bc91-3a595eab4b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:35.234292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2b2d1-55ef-41c6-bc91-3a595eab4b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:35.301220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2b2d1-55ef-41c6-bc91-3a595eab4b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:35.302734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2b2d1-55ef-41c6-bc91-3a595eab4b61 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:35.382374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:35.401493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 518/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 30 11:57:35.407611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:35.510138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fcc4f-dbbc-459c-b3b7-c3a9b8c9051a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:35.523878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:35.545671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:35.546501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:35.546791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:35.547071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:35.557836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:35.559257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:35.577467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:35.578553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:35.579472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:35.579472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:35.579472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:35.579472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:35.582328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 523/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:35.584553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2b2d1-55ef-41c6-bc91-3a595eab4b61 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:35.686719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2b2d1-55ef-41c6-bc91-3a595eab4b61 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:35.721564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:35.722254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:35.722543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:35.722829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:35.723554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:35.723863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:35.725248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:35.738590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 519/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:35.744299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:35.852188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f75d-072f-446c-aa24-c638fd8df505 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:35.886509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2417887-366f-4ee1-98fd-f8b7220ea3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:35.887361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2417887-366f-4ee1-98fd-f8b7220ea3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:35.887655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2417887-366f-4ee1-98fd-f8b7220ea3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:35.887935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2417887-366f-4ee1-98fd-f8b7220ea3e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:35.894677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2417887-366f-4ee1-98fd-f8b7220ea3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:35.896171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2417887-366f-4ee1-98fd-f8b7220ea3e5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-b2417887-366f-4ee1-98fd-f8b7220ea3e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:35.909712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:35.910603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:35.911495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 524/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:35.916624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:35.934092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ce79-ae3b-4097-b2fe-c0e2e62cf699 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:35.934601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ce79-ae3b-4097-b2fe-c0e2e62cf699 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:35.934719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ce79-ae3b-4097-b2fe-c0e2e62cf699 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:35.936005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 525/1044] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:35.941556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed58b4-3f24-4111-8b30-d4d7c8751077 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:35.941845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed58b4-3f24-4111-8b30-d4d7c8751077 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:35.942206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed58b4-3f24-4111-8b30-d4d7c8751077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:35.959527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b2ed58b4-3f24-4111-8b30-d4d7c8751077 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:35.960690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b2ed58b4-3f24-4111-8b30-d4d7c8751077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:35.962822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:35.979681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:36.024093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae70c4-c530-4b6d-844b-a3004cdc5d23 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.032351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 526/1045] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:36.055392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed58b4-3f24-4111-8b30-d4d7c8751077 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.058831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.059496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.059776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.060049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.060832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:36.061139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:36.062597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:36.074806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 520/1046] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:36.081074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.166032 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed58b4-3f24-4111-8b30-d4d7c8751077 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.181508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece25085-e3b6-48ae-ba86-76287888b506 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.183042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:36.225642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.225864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30685a86-d353-496b-8cad-80b2622ea174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.226456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.226569 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685a86-d353-496b-8cad-80b2622ea174 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.226741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.226834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685a86-d353-496b-8cad-80b2622ea174 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.227018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] PATH_INFO: `/v3/services/image` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.227119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685a86-d353-496b-8cad-80b2622ea174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.227665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:36.227877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30685a86-d353-496b-8cad-80b2622ea174 None admin] RBAC: Adding query filter params (role.id=265b98d926324dd3abf543dcfd662462, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=7ca17dc23a924e41a657db3122445923) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:36.228187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30685a86-d353-496b-8cad-80b2622ea174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:36.229043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:36.229593 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30685a86-d353-496b-8cad-80b2622ea174 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:36.236006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 521/1047] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:36 2022] GET /identity/v3/role_assignments?user.id=7ca17dc23a924e41a657db3122445923&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=265b98d926324dd3abf543dcfd662462 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:36.237196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362ea2-07ec-42dd-8fdf-3b9920c17561 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.237480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362ea2-07ec-42dd-8fdf-3b9920c17561 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.237757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362ea2-07ec-42dd-8fdf-3b9920c17561 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.239150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 522/1048] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:36.244677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977733e5-9548-4fe0-8c1a-d92abf95e7b8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:36.244852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:36.245803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 30 11:57:36.247191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:36.248132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977733e5-9548-4fe0-8c1a-d92abf95e7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.248132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977733e5-9548-4fe0-8c1a-d92abf95e7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.248293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 527/1049] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 30 11:57:36 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:36.252404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.264904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-977733e5-9548-4fe0-8c1a-d92abf95e7b8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:36.266287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-977733e5-9548-4fe0-8c1a-d92abf95e7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:36.274809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:36.344054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 523/1050] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:36.368471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977733e5-9548-4fe0-8c1a-d92abf95e7b8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.369076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dda46-c412-48fe-a94d-1fdfc8a3706e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.406351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.407889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.408330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.408761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.409632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] RBAC: Adding query filter params (name=image) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:36.410162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:36.411732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:36.417805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 528/1051] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:36.426471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.475877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:36.482130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977733e5-9548-4fe0-8c1a-d92abf95e7b8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.513908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:36.517374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56055a8-f434-4d3d-9b44-e1c2d8dac98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.518333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56055a8-f434-4d3d-9b44-e1c2d8dac98c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.518632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56055a8-f434-4d3d-9b44-e1c2d8dac98c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.518912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56055a8-f434-4d3d-9b44-e1c2d8dac98c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.529301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56055a8-f434-4d3d-9b44-e1c2d8dac98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:36.536656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038cf9-77c6-4f16-bec7-3631a027bd38 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d56055a8-f434-4d3d-9b44-e1c2d8dac98c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:36.537737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:36.538838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:36.539672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 524/1052] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:36.544767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56055a8-f434-4d3d-9b44-e1c2d8dac98c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.574583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.575248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.575532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.575807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.576519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] RBAC: Adding query filter params (type=image) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:36.576824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:36.578216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:36.583870 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 529/1053] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:36.589334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.659522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56055a8-f434-4d3d-9b44-e1c2d8dac98c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.694807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6110a2d-9487-4a17-9fd4-d85084813a6d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.697582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.698313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.698602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.698877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.699625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:36.699933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:36.701351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:36.710594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 525/1054] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:36.716187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.737833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:36.747335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9b9b-9568-4b60-8f2d-f6903ee98c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.748238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9b9b-9568-4b60-8f2d-f6903ee98c3d None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.748529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9b9b-9568-4b60-8f2d-f6903ee98c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.748924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9b9b-9568-4b60-8f2d-f6903ee98c3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.750211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9b9b-9568-4b60-8f2d-f6903ee98c3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:36.756793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9b9b-9568-4b60-8f2d-f6903ee98c3d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:36.822079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21411cc8-acb0-442d-ada5-a8b864c181b4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:36.825181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 530/1055] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 11:57:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:57:36.869057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80dfea-aa84-4102-8e0a-e6ad68d031ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:36.870001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80dfea-aa84-4102-8e0a-e6ad68d031ce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:36.870269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80dfea-aa84-4102-8e0a-e6ad68d031ce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:36.870542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80dfea-aa84-4102-8e0a-e6ad68d031ce None admin] PATH_INFO: `/v3/users/d3647729d35a4cab810be8e73995135e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:36.886324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80dfea-aa84-4102-8e0a-e6ad68d031ce None admin] RBAC: Authorizing `identity:get_user(user_id=d3647729d35a4cab810be8e73995135e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:36.887846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80dfea-aa84-4102-8e0a-e6ad68d031ce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:36.889855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 526/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:36 2022] GET /identity/v3/users/d3647729d35a4cab810be8e73995135e => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:36.896167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9b9b-9568-4b60-8f2d-f6903ee98c3d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:36.899157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:37.007002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9b9b-9568-4b60-8f2d-f6903ee98c3d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:37.044172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c10a2-73e8-430a-a91d-608f2f7d31bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:37.045154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c10a2-73e8-430a-a91d-608f2f7d31bc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:37.045632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c10a2-73e8-430a-a91d-608f2f7d31bc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:37.045916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c10a2-73e8-430a-a91d-608f2f7d31bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:37.114567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c10a2-73e8-430a-a91d-608f2f7d31bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:37.116028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c10a2-73e8-430a-a91d-608f2f7d31bc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:37.123452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:37.224617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 531/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:57:37.226262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80dfea-aa84-4102-8e0a-e6ad68d031ce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:37.295240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:37.326544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80dfea-aa84-4102-8e0a-e6ad68d031ce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:37.361975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dbf12-3fab-4400-9847-d1fdd62038eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:37.362848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dbf12-3fab-4400-9847-d1fdd62038eb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:37.363132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dbf12-3fab-4400-9847-d1fdd62038eb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:37.363409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dbf12-3fab-4400-9847-d1fdd62038eb None admin] PATH_INFO: `/v3/projects/2861a75127144308b28630ed0486bd1c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:37.364601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dbf12-3fab-4400-9847-d1fdd62038eb None admin] RBAC: Authorizing `identity:get_project(project_id=2861a75127144308b28630ed0486bd1c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:37.366098 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dbf12-3fab-4400-9847-d1fdd62038eb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:37.367800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 527/1058] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:57:37 2022] GET /identity/v3/projects/2861a75127144308b28630ed0486bd1c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:37.373887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c10a2-73e8-430a-a91d-608f2f7d31bc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:37.478731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c10a2-73e8-430a-a91d-608f2f7d31bc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:37.480276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:37.513274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4094ff-c24d-4fdb-8dfd-6cc2f5b93b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:37.513926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4094ff-c24d-4fdb-8dfd-6cc2f5b93b84 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:37.514378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4094ff-c24d-4fdb-8dfd-6cc2f5b93b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:37.514661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4094ff-c24d-4fdb-8dfd-6cc2f5b93b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:37.515488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4094ff-c24d-4fdb-8dfd-6cc2f5b93b84 None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=2861a75127144308b28630ed0486bd1c, user.id=d3647729d35a4cab810be8e73995135e) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:37.515804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4094ff-c24d-4fdb-8dfd-6cc2f5b93b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:37.517261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4094ff-c24d-4fdb-8dfd-6cc2f5b93b84 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:37.529998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 532/1059] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:37 2022] GET /identity/v3/role_assignments?user.id=d3647729d35a4cab810be8e73995135e&scope.project.id=2861a75127144308b28630ed0486bd1c&role.id=f3f138e4021a4b7dada39089dd427266 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:38.499381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6d9be-e33a-4056-890d-4ee24c51d0ba None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:38.499935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6d9be-e33a-4056-890d-4ee24c51d0ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:38.499935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6d9be-e33a-4056-890d-4ee24c51d0ba None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:38.502005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 528/1060] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:38.507095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ce4f-6a53-4687-b5b1-b52beb297024 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:38.507473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ce4f-6a53-4687-b5b1-b52beb297024 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:38.507660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ce4f-6a53-4687-b5b1-b52beb297024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:38.525156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-93f8ce4f-6a53-4687-b5b1-b52beb297024 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:38.526369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-93f8ce4f-6a53-4687-b5b1-b52beb297024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:38.592840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 533/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:38.616080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6d9be-e33a-4056-890d-4ee24c51d0ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:38.722280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6d9be-e33a-4056-890d-4ee24c51d0ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:38.762693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50c90e-3805-412a-8498-5e1db6720736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:38.763533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50c90e-3805-412a-8498-5e1db6720736 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:38.763816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50c90e-3805-412a-8498-5e1db6720736 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:38.764086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50c90e-3805-412a-8498-5e1db6720736 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:38.774303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:38.777868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50c90e-3805-412a-8498-5e1db6720736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1a50c90e-3805-412a-8498-5e1db6720736 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:38.787477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:38.791735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:38.792599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 529/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 30 11:57:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:38.795088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ce4f-6a53-4687-b5b1-b52beb297024 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:38.892064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:38.898522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ce4f-6a53-4687-b5b1-b52beb297024 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:38.933508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00898acf-b602-48e3-b515-267bea608a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:38.934212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00898acf-b602-48e3-b515-267bea608a7d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:38.934505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00898acf-b602-48e3-b515-267bea608a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:38.934787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00898acf-b602-48e3-b515-267bea608a7d None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:38.935541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00898acf-b602-48e3-b515-267bea608a7d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:38.935850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00898acf-b602-48e3-b515-267bea608a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:38.937282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00898acf-b602-48e3-b515-267bea608a7d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:38.950192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 534/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 30 11:57:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:38.951478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50c90e-3805-412a-8498-5e1db6720736 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.053212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50c90e-3805-412a-8498-5e1db6720736 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.086933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.087728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.088013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.088287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.099480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.101020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:39.101675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7459b5-1e90-4241-81f3-8d2392bdf1a7 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.101996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7459b5-1e90-4241-81f3-8d2392bdf1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.102278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7459b5-1e90-4241-81f3-8d2392bdf1a7 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.103669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 535/1064] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:39.108554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a494-e596-4f67-b484-0564d0bc99cb None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.108956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a494-e596-4f67-b484-0564d0bc99cb None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.109247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7a494-e596-4f67-b484-0564d0bc99cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:39.119298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:39.120203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:39.121203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:39.121203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:39.121203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:39.121203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:39.122779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 530/1065] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:39.128281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.131334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-12c7a494-e596-4f67-b484-0564d0bc99cb None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:39.132512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-12c7a494-e596-4f67-b484-0564d0bc99cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:39.184328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:39.202927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 536/1066] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:39.225522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a494-e596-4f67-b484-0564d0bc99cb None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.232717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8c08e-dd62-4473-807c-5fe5a6eb9ffe None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.268878 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.269538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.269820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.270127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.270838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:39.271142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.272519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:39.285314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 531/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:39.290761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.323228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:39.334631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7a494-e596-4f67-b484-0564d0bc99cb None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.370078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb1be6-caa8-4f7b-8392-b00a657ef95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.370735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1be6-caa8-4f7b-8392-b00a657ef95b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.371023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1be6-caa8-4f7b-8392-b00a657ef95b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.371301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1be6-caa8-4f7b-8392-b00a657ef95b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.401224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02bca1-8a9e-4417-8684-75fb18101b4d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.417318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:39.441046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.443188 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.443483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.443796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.444879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb1be6-caa8-4f7b-8392-b00a657ef95b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.446701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb1be6-caa8-4f7b-8392-b00a657ef95b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:39.452352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.454494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:39.470833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:39.472034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:39.472977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 532/1068] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:57:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:39.477554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.552411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:39.565385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 537/1069] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 30 11:57:39.571367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb1be6-caa8-4f7b-8392-b00a657ef95b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.586878 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f42b-e20b-4e1b-9fb7-2438d607b23b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.625657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.626368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.626662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.626946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.627793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:39.628128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.629591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:39.647426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 533/1070] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:57:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:39.653685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.684190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb1be6-caa8-4f7b-8392-b00a657ef95b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.685155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:39.733095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.733931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.734244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.734518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.745727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.747219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:39.765547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:39.767184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:39.768144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:39.768144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:39.768144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:39.768144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:39.768383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadcb01-dda3-436d-82dc-9b90562625c1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.768471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 538/1071] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:39.773082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.804815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e89d6-b859-4df9-a0e9-f4fa2d37933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.805604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e89d6-b859-4df9-a0e9-f4fa2d37933a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.805892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e89d6-b859-4df9-a0e9-f4fa2d37933a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.806194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e89d6-b859-4df9-a0e9-f4fa2d37933a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.815810 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:39.817077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e89d6-b859-4df9-a0e9-f4fa2d37933a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.818826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e89d6-b859-4df9-a0e9-f4fa2d37933a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-da6e89d6-b859-4df9-a0e9-f4fa2d37933a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:39.836854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:39.837818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:39.839128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:39.839128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:39.839128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:39.839128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:39.839128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 534/1072] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:39.840944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cfd4-1a8c-423d-8902-66708e02d88c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.841241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cfd4-1a8c-423d-8902-66708e02d88c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.841524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cfd4-1a8c-423d-8902-66708e02d88c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.842952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 535/1073] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:39.843658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1cfd4-1a8c-423d-8902-66708e02d88c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:39.872796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ad6cc-d0af-41b0-9c2f-d491fe7dcd63 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.906611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9b225-60c0-4db9-8eac-b5da3647ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.907268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9b225-60c0-4db9-8eac-b5da3647ea47 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.907552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9b225-60c0-4db9-8eac-b5da3647ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.907830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9b225-60c0-4db9-8eac-b5da3647ea47 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.908547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9b225-60c0-4db9-8eac-b5da3647ea47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:39.908853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9b225-60c0-4db9-8eac-b5da3647ea47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.910248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9b225-60c0-4db9-8eac-b5da3647ea47 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:39.921034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 539/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:39.922279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822a0e-a728-48df-aa97-b7a13d913dd2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.922572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822a0e-a728-48df-aa97-b7a13d913dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.922862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0822a0e-a728-48df-aa97-b7a13d913dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.930397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:39.947752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-a0822a0e-a728-48df-aa97-b7a13d913dd2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:39.949026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a0822a0e-a728-48df-aa97-b7a13d913dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:39.953313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1cfd4-1a8c-423d-8902-66708e02d88c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:39.992231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:39.992900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:39.993186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:39.993467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:39.994244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:39.994553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:39.995980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:40.009414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 536/1075] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:40.015274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:40.032321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 540/1076] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:40.054829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0822a0e-a728-48df-aa97-b7a13d913dd2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:40.086210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:40.124981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de93ab-f996-4583-b986-e1122da2cd29 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:40.164462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:40.166013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:40.166013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:40.166013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:40.174714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:40.176254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:40.178596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0822a0e-a728-48df-aa97-b7a13d913dd2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:40.191621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:40.192812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:40.193717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:40.193717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:40.193717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:40.193717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:40.193717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:40.193717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:40.193717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:40.193717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:40.197992 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 537/1077] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:40.199256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:40.202058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:40.222324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd435c4f-e622-4c61-9e7e-f72ded61752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:40.223484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435c4f-e622-4c61-9e7e-f72ded61752c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:40.223941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435c4f-e622-4c61-9e7e-f72ded61752c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:40.224216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435c4f-e622-4c61-9e7e-f72ded61752c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:40.236714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd435c4f-e622-4c61-9e7e-f72ded61752c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-dd435c4f-e622-4c61-9e7e-f72ded61752c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:40.245776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:40.246812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:40.247663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 541/1078] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:40.253434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd435c4f-e622-4c61-9e7e-f72ded61752c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:40.310748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ad86-6160-4425-9146-2e50b511a450 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:40.341672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:40.344376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:40.345031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:40.345318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:40.345597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:40.346410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:40.346719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:40.348162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:40.351176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd435c4f-e622-4c61-9e7e-f72ded61752c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:40.360224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 538/1079] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:40.365984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:40.385052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:40.385652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:40.385936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:40.386243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:40.386980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:40.387309 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:40.388698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:40.396818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 542/1080] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:40.402518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:40.425792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:40.464047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e657-a4e7-4b35-ac33-567e13abd52b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:40.497103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea85bb-3d4e-43fb-bb85-55a9a395f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:40.498011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea85bb-3d4e-43fb-bb85-55a9a395f8ec None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:40.498298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea85bb-3d4e-43fb-bb85-55a9a395f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:40.498575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea85bb-3d4e-43fb-bb85-55a9a395f8ec None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/7ca17dc23a924e41a657db3122445923/roles/265b98d926324dd3abf543dcfd662462` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:40.499162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca88169-b898-484f-8c96-f77a3e1f4b59 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:40.500828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea85bb-3d4e-43fb-bb85-55a9a395f8ec None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=7ca17dc23a924e41a657db3122445923, role_id=265b98d926324dd3abf543dcfd662462)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:40.502304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea85bb-3d4e-43fb-bb85-55a9a395f8ec None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:40.532698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1b6c0-693d-41a3-9ec7-43f4bc420fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:40.533556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b6c0-693d-41a3-9ec7-43f4bc420fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:40.533843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b6c0-693d-41a3-9ec7-43f4bc420fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:40.534151 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b6c0-693d-41a3-9ec7-43f4bc420fc2 None admin] PATH_INFO: `/v3/users/d3647729d35a4cab810be8e73995135e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:40.535336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1b6c0-693d-41a3-9ec7-43f4bc420fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=d3647729d35a4cab810be8e73995135e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:40.536757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1b6c0-693d-41a3-9ec7-43f4bc420fc2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:40.538407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 543/1081] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:40 2022] GET /identity/v3/users/d3647729d35a4cab810be8e73995135e => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:40.544022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1b6c0-693d-41a3-9ec7-43f4bc420fc2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:40.565490 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:40.567217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 539/1082] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:57:40 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/7ca17dc23a924e41a657db3122445923/roles/265b98d926324dd3abf543dcfd662462 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:57:40.650517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1b6c0-693d-41a3-9ec7-43f4bc420fc2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:40.687150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f99a91-dff7-4033-bee6-b50d42a035ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:40.688035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f99a91-dff7-4033-bee6-b50d42a035ed None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:40.688324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f99a91-dff7-4033-bee6-b50d42a035ed None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:40.688606 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f99a91-dff7-4033-bee6-b50d42a035ed None admin] PATH_INFO: `/v3/projects/2861a75127144308b28630ed0486bd1c` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:40.689830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f99a91-dff7-4033-bee6-b50d42a035ed None admin] RBAC: Authorizing `identity:get_project(project_id=2861a75127144308b28630ed0486bd1c)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:40.691329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f99a91-dff7-4033-bee6-b50d42a035ed None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:40.693324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 544/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:57:40 2022] GET /identity/v3/projects/2861a75127144308b28630ed0486bd1c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:40.699452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea85bb-3d4e-43fb-bb85-55a9a395f8ec None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:40.805255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea85bb-3d4e-43fb-bb85-55a9a395f8ec None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:40.826945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:40.838130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09276e-dcde-409e-9448-b8ace1d1d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:40.845280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09276e-dcde-409e-9448-b8ace1d1d938 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:40.845280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09276e-dcde-409e-9448-b8ace1d1d938 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:40.845280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09276e-dcde-409e-9448-b8ace1d1d938 None admin] PATH_INFO: `/v3/projects/2861a75127144308b28630ed0486bd1c/users/d3647729d35a4cab810be8e73995135e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:40.845280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09276e-dcde-409e-9448-b8ace1d1d938 None admin] RBAC: Authorizing `identity:create_grant(project_id=2861a75127144308b28630ed0486bd1c, user_id=d3647729d35a4cab810be8e73995135e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:40.845280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09276e-dcde-409e-9448-b8ace1d1d938 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:40.921699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 540/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:57:40 2022] PUT /identity/v3/projects/2861a75127144308b28630ed0486bd1c/users/d3647729d35a4cab810be8e73995135e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 11:57:42.783669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e42b-3059-46ed-ad34-37c5fc53d0ee None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:42.784155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e42b-3059-46ed-ad34-37c5fc53d0ee None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:42.784247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4e42b-3059-46ed-ad34-37c5fc53d0ee None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:42.785612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 545/1085] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:42.790745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3272-b124-4719-a2d9-c6e454e1507f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:42.791166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3272-b124-4719-a2d9-c6e454e1507f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:42.791429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3272-b124-4719-a2d9-c6e454e1507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:42.807909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-db1a3272-b124-4719-a2d9-c6e454e1507f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:42.809079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-db1a3272-b124-4719-a2d9-c6e454e1507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:42.879500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 541/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:42.903202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4e42b-3059-46ed-ad34-37c5fc53d0ee None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:42.989699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:43.017793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4e42b-3059-46ed-ad34-37c5fc53d0ee None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.034989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767ae5b-71ca-4e25-aa58-6eb81fea27a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.035956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767ae5b-71ca-4e25-aa58-6eb81fea27a2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.036612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767ae5b-71ca-4e25-aa58-6eb81fea27a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.036886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767ae5b-71ca-4e25-aa58-6eb81fea27a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.046726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767ae5b-71ca-4e25-aa58-6eb81fea27a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-2767ae5b-71ca-4e25-aa58-6eb81fea27a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:43.054907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:43.055929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:43.056805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 546/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 30 11:57:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:43.061951 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a3272-b124-4719-a2d9-c6e454e1507f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.158668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a640f-da71-460e-b8fa-f0eb90f17918 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.158960 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a640f-da71-460e-b8fa-f0eb90f17918 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.159239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a640f-da71-460e-b8fa-f0eb90f17918 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.159370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a3272-b124-4719-a2d9-c6e454e1507f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.160706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 547/1088] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 11:57:43.165707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90e8b5-63a8-47b4-9f3b-05caaaaec733 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.166020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90e8b5-63a8-47b4-9f3b-05caaaaec733 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.171431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90e8b5-63a8-47b4-9f3b-05caaaaec733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.173720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:43.183337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-6f90e8b5-63a8-47b4-9f3b-05caaaaec733 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:43.184545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6f90e8b5-63a8-47b4-9f3b-05caaaaec733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:43.195068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.195731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.196024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.196298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.197042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:43.197345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:43.198752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:43.206875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 542/1089] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:43.212492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.253990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 548/1090] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:43.278028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90e8b5-63a8-47b4-9f3b-05caaaaec733 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.312202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b070a-04cd-4c72-aa12-4b2d51272d92 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.345547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.346372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.346659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.346936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.353384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:43.357479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:43.358948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:43.374623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90e8b5-63a8-47b4-9f3b-05caaaaec733 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:43.376786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:43.377715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:43.378957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:43.378957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:43.378957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:43.378957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:43.378957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 543/1091] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:43.383750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.408918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66f560-a3b3-44eb-909d-6f3bef64e2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.409711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f560-a3b3-44eb-909d-6f3bef64e2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.410020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f560-a3b3-44eb-909d-6f3bef64e2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.410300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f560-a3b3-44eb-909d-6f3bef64e2c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.410867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:43.420775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66f560-a3b3-44eb-909d-6f3bef64e2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-4b66f560-a3b3-44eb-909d-6f3bef64e2c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:57:43.429030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:43.430320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:57:43.431366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 549/1092] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:43.436009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66f560-a3b3-44eb-909d-6f3bef64e2c1 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.486793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330d15-9dc8-4ba3-9f3f-9e2128635dbb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.519944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.520605 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.520900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.521220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.521950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:43.522296 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:43.523670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:43.535816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 544/1093] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:43.536430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66f560-a3b3-44eb-909d-6f3bef64e2c1 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.541185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.570516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.571179 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.571465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.571740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.572477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:43.572779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:43.574164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:43.579443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:43.583192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 550/1094] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:43.588851 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.624628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:43.639421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ecea3-f7a7-4014-bfc9-6090b575cfa2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.674938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.675726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.676019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.676297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.683209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:43.684660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:43.686934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1154c3-25f0-46c8-b616-7a7cbe4e7a09 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:57:43.699284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:43.700434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:43.701692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 545/1095] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:57:43.706102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.724249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40aaf-688f-415d-b665-973975d225ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.725113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40aaf-688f-415d-b665-973975d225ee None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.725391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40aaf-688f-415d-b665-973975d225ee None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.725666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40aaf-688f-415d-b665-973975d225ee None admin] PATH_INFO: `/v3/users/d3647729d35a4cab810be8e73995135e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.726869 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d40aaf-688f-415d-b665-973975d225ee None admin] RBAC: Authorizing `identity:get_user(user_id=d3647729d35a4cab810be8e73995135e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:43.731254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d40aaf-688f-415d-b665-973975d225ee None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:43.731254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 551/1096] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/users/d3647729d35a4cab810be8e73995135e => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:43.736402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40aaf-688f-415d-b665-973975d225ee None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.803325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:43.809405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2f344-4c4e-4b5b-98bb-078bb2cb3920 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.835393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40aaf-688f-415d-b665-973975d225ee None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:43.842599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.843259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.843542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.844334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.845167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:43.845470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:43.846940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:43.864221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 546/1097] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:43.869662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef68a55-8309-4fec-a09f-6451b700fe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:43.869802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:43.870334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68a55-8309-4fec-a09f-6451b700fe3f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:43.870622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68a55-8309-4fec-a09f-6451b700fe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:43.870902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68a55-8309-4fec-a09f-6451b700fe3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:43.873574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:43.938806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef68a55-8309-4fec-a09f-6451b700fe3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:43.940288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef68a55-8309-4fec-a09f-6451b700fe3f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:43.967950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac93a8-81da-4088-9532-c855bb75f1c4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:44.001392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030423e0-54f6-4000-a92c-1bee93bb462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:44.002061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030423e0-54f6-4000-a92c-1bee93bb462a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:44.002349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030423e0-54f6-4000-a92c-1bee93bb462a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:44.002638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030423e0-54f6-4000-a92c-1bee93bb462a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:44.004848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:44.038709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 552/1098] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 30 11:57:44.044526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef68a55-8309-4fec-a09f-6451b700fe3f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:44.069920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030423e0-54f6-4000-a92c-1bee93bb462a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:44.071359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030423e0-54f6-4000-a92c-1bee93bb462a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:44.074176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:44.140265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef68a55-8309-4fec-a09f-6451b700fe3f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:44.168115 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 547/1099] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 30 11:57:44.173691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030423e0-54f6-4000-a92c-1bee93bb462a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:44.174355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149626a7-b4ab-4aae-8d47-ac1ea7452712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:44.175231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149626a7-b4ab-4aae-8d47-ac1ea7452712 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:44.175522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149626a7-b4ab-4aae-8d47-ac1ea7452712 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:44.175804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149626a7-b4ab-4aae-8d47-ac1ea7452712 None admin] PATH_INFO: `/v3/projects/2861a75127144308b28630ed0486bd1c` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:44.176975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149626a7-b4ab-4aae-8d47-ac1ea7452712 None admin] RBAC: Authorizing `identity:get_project(project_id=2861a75127144308b28630ed0486bd1c)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:44.178457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149626a7-b4ab-4aae-8d47-ac1ea7452712 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:44.184910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 553/1100] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:57:44 2022] GET /identity/v3/projects/2861a75127144308b28630ed0486bd1c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:57:44.185827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149626a7-b4ab-4aae-8d47-ac1ea7452712 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:44.222500 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:44.272058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030423e0-54f6-4000-a92c-1bee93bb462a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:44.274411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:44.286186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149626a7-b4ab-4aae-8d47-ac1ea7452712 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:44.305109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:44.305907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:44.306661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:44.306948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:44.317930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:44.319419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:44.320892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:44.321472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:44.321758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:44.322076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:44.322925 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=2861a75127144308b28630ed0486bd1c, user.id=d3647729d35a4cab810be8e73995135e) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:44.323242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:44.324655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:44.331103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 554/1101] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:44 2022] GET /identity/v3/role_assignments?user.id=d3647729d35a4cab810be8e73995135e&scope.project.id=2861a75127144308b28630ed0486bd1c&role.id=f3f138e4021a4b7dada39089dd427266 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:57:44.337899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:44.339053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:44.340166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:57:44.340166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:57:44.340166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:57:44.340166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:44.340166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 548/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:44.345318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:44.446932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:44.449967 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe1cf9-fc82-44b0-9da5-ab60e3d59cd6 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:44.486417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:44.487100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:44.487388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:44.487670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:44.488403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:44.488713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:44.490121 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:44.502892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 555/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:44.508521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:44.608931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be991f1-2a51-4d5f-88be-b802888cd5fa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:44.643067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:44.643859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:44.644144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:44.644422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:44.651128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:44.652586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:57:44.666067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:57:44.666941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:57:44.667831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:57:44.667831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:57:44.667831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:57:44.667831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:57:44.667831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:57:44.667831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:57:44.667831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:57:44.667831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:57:44.668375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 549/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:57:44.673444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:44.779193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94501417-d954-4a9d-ba21-a6aa1d4c5031 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:44.811585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a466b-5cea-43fc-bf5d-b7c75177b118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:44.812244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a466b-5cea-43fc-bf5d-b7c75177b118 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:44.813092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a466b-5cea-43fc-bf5d-b7c75177b118 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:44.813373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a466b-5cea-43fc-bf5d-b7c75177b118 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:44.814227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a466b-5cea-43fc-bf5d-b7c75177b118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:44.814539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a466b-5cea-43fc-bf5d-b7c75177b118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:44.815995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a466b-5cea-43fc-bf5d-b7c75177b118 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:44.833100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 556/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:44.834343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:44.852500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:44.931315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b01c-e6e6-4c5a-8d65-9a831f2c4544 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:44.963843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcccac-fae1-40f2-9002-9d64386c34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:44.964490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcccac-fae1-40f2-9002-9d64386c34d0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:44.964770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcccac-fae1-40f2-9002-9d64386c34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:44.965045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcccac-fae1-40f2-9002-9d64386c34d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:44.965861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcccac-fae1-40f2-9002-9d64386c34d0 None admin] RBAC: Adding query filter params (role.id=265b98d926324dd3abf543dcfd662462, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=7ca17dc23a924e41a657db3122445923) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:44.966199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcccac-fae1-40f2-9002-9d64386c34d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:44.967631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcccac-fae1-40f2-9002-9d64386c34d0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:44.973796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 550/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:44 2022] GET /identity/v3/role_assignments?user.id=7ca17dc23a924e41a657db3122445923&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=265b98d926324dd3abf543dcfd662462 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:46.616222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5360-eb54-4861-8e09-ec359ec97d6d None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:46.616747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5360-eb54-4861-8e09-ec359ec97d6d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:46.616863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5360-eb54-4861-8e09-ec359ec97d6d None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:46.618203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 557/1107] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:46.623607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f0e20-eabb-4b37-9d69-5b161c4152cf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:46.624005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f0e20-eabb-4b37-9d69-5b161c4152cf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:46.624168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f0e20-eabb-4b37-9d69-5b161c4152cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:46.641594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-251f0e20-eabb-4b37-9d69-5b161c4152cf None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:46.642793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-251f0e20-eabb-4b37-9d69-5b161c4152cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:46.706691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 551/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:57:46.730817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db5360-eb54-4861-8e09-ec359ec97d6d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:46.754928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:46.831965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db5360-eb54-4861-8e09-ec359ec97d6d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:46.864001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22d474-86c1-4640-9be7-465f34ea219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:46.864771 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d474-86c1-4640-9be7-465f34ea219e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:46.865055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d474-86c1-4640-9be7-465f34ea219e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:46.865330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d474-86c1-4640-9be7-465f34ea219e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:46.866536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22d474-86c1-4640-9be7-465f34ea219e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:46.867908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22d474-86c1-4640-9be7-465f34ea219e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:46.869476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 558/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:46.875764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f0e20-eabb-4b37-9d69-5b161c4152cf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:46.887051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:46.971971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f0e20-eabb-4b37-9d69-5b161c4152cf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:47.005437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2564b3-d20a-4839-909e-519b0117c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:47.006124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2564b3-d20a-4839-909e-519b0117c4c1 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:47.006415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2564b3-d20a-4839-909e-519b0117c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:47.006697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2564b3-d20a-4839-909e-519b0117c4c1 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:47.007413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2564b3-d20a-4839-909e-519b0117c4c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:47.008841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2564b3-d20a-4839-909e-519b0117c4c1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:47.080794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 552/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:57:46 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:57:49.352592 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49175d39-e585-4574-b69d-8ba88f411ddc None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:49.353131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49175d39-e585-4574-b69d-8ba88f411ddc None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:49.353131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49175d39-e585-4574-b69d-8ba88f411ddc None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:49.354537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 559/1111] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:49.360200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e616-5e28-41c9-b3de-5ef0bef82cea None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:49.360622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e616-5e28-41c9-b3de-5ef0bef82cea None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:49.360802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e616-5e28-41c9-b3de-5ef0bef82cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:49.377709 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3d72e616-5e28-41c9-b3de-5ef0bef82cea None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:49.378925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3d72e616-5e28-41c9-b3de-5ef0bef82cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:49.435761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:49.443947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 553/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:49.467310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49175d39-e585-4574-b69d-8ba88f411ddc None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:49.552995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:49.565287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49175d39-e585-4574-b69d-8ba88f411ddc None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:49.598327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e411-a816-4d9d-b91f-c6b0accc8398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:49.599154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e411-a816-4d9d-b91f-c6b0accc8398 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:49.599436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e411-a816-4d9d-b91f-c6b0accc8398 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:49.599716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e411-a816-4d9d-b91f-c6b0accc8398 None admin] PATH_INFO: `/v3/roles/961dfd3ce0344659aaf2e9c80164893e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:49.601148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820e411-a816-4d9d-b91f-c6b0accc8398 None admin] RBAC: Authorizing `identity:get_role(role_id=961dfd3ce0344659aaf2e9c80164893e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:49.602534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820e411-a816-4d9d-b91f-c6b0accc8398 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:49.603914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 560/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:49 2022] GET /identity/v3/roles/961dfd3ce0344659aaf2e9c80164893e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:49.610054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72e616-5e28-41c9-b3de-5ef0bef82cea None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:49.705877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72e616-5e28-41c9-b3de-5ef0bef82cea None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:49.739240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b43a86-f9e0-4a82-9eb6-1a6bdd25d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:49.740104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b43a86-f9e0-4a82-9eb6-1a6bdd25d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:49.740390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b43a86-f9e0-4a82-9eb6-1a6bdd25d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:49.740668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b43a86-f9e0-4a82-9eb6-1a6bdd25d7c5 None admin] PATH_INFO: `/v3/users/26454bb4e06246bea1195a7311587f17` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:49.753834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b43a86-f9e0-4a82-9eb6-1a6bdd25d7c5 None admin] RBAC: Authorizing `identity:get_user(user_id=26454bb4e06246bea1195a7311587f17)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:49.755321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b43a86-f9e0-4a82-9eb6-1a6bdd25d7c5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:49.756956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 554/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:49 2022] GET /identity/v3/users/26454bb4e06246bea1195a7311587f17 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:49.762632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e411-a816-4d9d-b91f-c6b0accc8398 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:49.857484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e411-a816-4d9d-b91f-c6b0accc8398 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:49.889657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a2f1-0be3-40c6-a7be-3e03fac85156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:49.890864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a2f1-0be3-40c6-a7be-3e03fac85156 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:49.891124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a2f1-0be3-40c6-a7be-3e03fac85156 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:49.891397 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a2f1-0be3-40c6-a7be-3e03fac85156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:49.914924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:49.955620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a2f1-0be3-40c6-a7be-3e03fac85156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:49.957049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a2f1-0be3-40c6-a7be-3e03fac85156 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:50.049973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 561/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:57:50.055849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b43a86-f9e0-4a82-9eb6-1a6bdd25d7c5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:50.110297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:50.152992 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b43a86-f9e0-4a82-9eb6-1a6bdd25d7c5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:50.185512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71cc35-e6a8-461c-a499-80ab0779161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:50.186394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71cc35-e6a8-461c-a499-80ab0779161b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:50.186676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71cc35-e6a8-461c-a499-80ab0779161b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:50.186946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71cc35-e6a8-461c-a499-80ab0779161b None admin] PATH_INFO: `/v3/projects/2861a75127144308b28630ed0486bd1c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:50.188703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71cc35-e6a8-461c-a499-80ab0779161b None admin] RBAC: Authorizing `identity:get_project(project_id=2861a75127144308b28630ed0486bd1c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:50.190181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71cc35-e6a8-461c-a499-80ab0779161b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:50.191857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 555/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:57:50 2022] GET /identity/v3/projects/2861a75127144308b28630ed0486bd1c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:50.198041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a2f1-0be3-40c6-a7be-3e03fac85156 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:50.251610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:50.292799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a2f1-0be3-40c6-a7be-3e03fac85156 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:50.326353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0844c-88f1-4d80-a0e4-66aa3beb9d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:50.326988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0844c-88f1-4d80-a0e4-66aa3beb9d41 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:50.327274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0844c-88f1-4d80-a0e4-66aa3beb9d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:50.327552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0844c-88f1-4d80-a0e4-66aa3beb9d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:50.328402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0844c-88f1-4d80-a0e4-66aa3beb9d41 None admin] RBAC: Adding query filter params (role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=2861a75127144308b28630ed0486bd1c, user.id=26454bb4e06246bea1195a7311587f17) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:50.328713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0844c-88f1-4d80-a0e4-66aa3beb9d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:50.330169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0844c-88f1-4d80-a0e4-66aa3beb9d41 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:50.335396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 562/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:50 2022] GET /identity/v3/role_assignments?user.id=26454bb4e06246bea1195a7311587f17&scope.project.id=2861a75127144308b28630ed0486bd1c&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:52.541142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0dfa6-4fb8-4e96-80bd-018e3f24cd92 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:52.541660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0dfa6-4fb8-4e96-80bd-018e3f24cd92 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:52.541751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0dfa6-4fb8-4e96-80bd-018e3f24cd92 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:52.543124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 556/1118] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:52.548337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502c0d-ab90-4699-b81c-840eb1e1df78 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:52.548760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502c0d-ab90-4699-b81c-840eb1e1df78 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:52.548901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502c0d-ab90-4699-b81c-840eb1e1df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:52.565758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-17502c0d-ab90-4699-b81c-840eb1e1df78 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:52.567249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-17502c0d-ab90-4699-b81c-840eb1e1df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:52.631611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 563/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:52.654861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0dfa6-4fb8-4e96-80bd-018e3f24cd92 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:52.753677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0dfa6-4fb8-4e96-80bd-018e3f24cd92 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:52.776018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:52.786812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a20a4f-2b78-4c5e-b836-59d4f8f63da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:52.796383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20a4f-2b78-4c5e-b836-59d4f8f63da1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:52.796383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20a4f-2b78-4c5e-b836-59d4f8f63da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:52.796383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20a4f-2b78-4c5e-b836-59d4f8f63da1 None admin] PATH_INFO: `/v3/roles/961dfd3ce0344659aaf2e9c80164893e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:52.796383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a20a4f-2b78-4c5e-b836-59d4f8f63da1 None admin] RBAC: Authorizing `identity:get_role(role_id=961dfd3ce0344659aaf2e9c80164893e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:52.796383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a20a4f-2b78-4c5e-b836-59d4f8f63da1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:52.796383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 557/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:52 2022] GET /identity/v3/roles/961dfd3ce0344659aaf2e9c80164893e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:52.798330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502c0d-ab90-4699-b81c-840eb1e1df78 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:52.846777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:52.895294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502c0d-ab90-4699-b81c-840eb1e1df78 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:52.928250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a710b9-ee91-45c8-8f0b-649cd3726fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:52.929116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a710b9-ee91-45c8-8f0b-649cd3726fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:52.929404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a710b9-ee91-45c8-8f0b-649cd3726fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:52.929681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a710b9-ee91-45c8-8f0b-649cd3726fa4 None admin] PATH_INFO: `/v3/users/26454bb4e06246bea1195a7311587f17` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:52.930879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a710b9-ee91-45c8-8f0b-649cd3726fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=26454bb4e06246bea1195a7311587f17)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:52.932321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a710b9-ee91-45c8-8f0b-649cd3726fa4 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:52.933974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 564/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:52 2022] GET /identity/v3/users/26454bb4e06246bea1195a7311587f17 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:52.940439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a20a4f-2b78-4c5e-b836-59d4f8f63da1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:53.035850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a20a4f-2b78-4c5e-b836-59d4f8f63da1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:53.067762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841b88b-4545-4934-a7e9-163c0ed1507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:53.068546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841b88b-4545-4934-a7e9-163c0ed1507c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:53.068827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841b88b-4545-4934-a7e9-163c0ed1507c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:53.069096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841b88b-4545-4934-a7e9-163c0ed1507c None admin] PATH_INFO: `/v3/projects/2861a75127144308b28630ed0486bd1c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:53.070263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841b88b-4545-4934-a7e9-163c0ed1507c None admin] RBAC: Authorizing `identity:get_project(project_id=2861a75127144308b28630ed0486bd1c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:53.071678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841b88b-4545-4934-a7e9-163c0ed1507c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:53.073301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 558/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:57:52 2022] GET /identity/v3/projects/2861a75127144308b28630ed0486bd1c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:53.079757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a710b9-ee91-45c8-8f0b-649cd3726fa4 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:53.175281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a710b9-ee91-45c8-8f0b-649cd3726fa4 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:53.191705 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:53.208733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d84852-ef01-425f-8a96-dc9f6460adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:53.209594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84852-ef01-425f-8a96-dc9f6460adf8 None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:53.209883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84852-ef01-425f-8a96-dc9f6460adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:53.210191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84852-ef01-425f-8a96-dc9f6460adf8 None admin] PATH_INFO: `/v3/projects/2861a75127144308b28630ed0486bd1c/users/26454bb4e06246bea1195a7311587f17/roles/961dfd3ce0344659aaf2e9c80164893e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:53.212377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d84852-ef01-425f-8a96-dc9f6460adf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2861a75127144308b28630ed0486bd1c, user_id=26454bb4e06246bea1195a7311587f17, role_id=961dfd3ce0344659aaf2e9c80164893e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:53.213801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d84852-ef01-425f-8a96-dc9f6460adf8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:53.285883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 565/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:57:53 2022] PUT /identity/v3/projects/2861a75127144308b28630ed0486bd1c/users/26454bb4e06246bea1195a7311587f17/roles/961dfd3ce0344659aaf2e9c80164893e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:57:55.494828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c28f-a6b3-426a-9185-5f5629be7f10 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:55.495377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c28f-a6b3-426a-9185-5f5629be7f10 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:55.495377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9c28f-a6b3-426a-9185-5f5629be7f10 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:55.496748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 559/1124] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:55.502452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa066-6690-4ece-bc56-d2c06a475973 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:55.502870 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa066-6690-4ece-bc56-d2c06a475973 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:55.503015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa066-6690-4ece-bc56-d2c06a475973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:55.519926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-699fa066-6690-4ece-bc56-d2c06a475973 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:55.521105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-699fa066-6690-4ece-bc56-d2c06a475973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:55.585231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 566/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:55.608146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c28f-a6b3-426a-9185-5f5629be7f10 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:55.665882 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:55.707324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9c28f-a6b3-426a-9185-5f5629be7f10 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:55.739619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0078b-1315-4118-992a-7450ba747835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:55.740472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0078b-1315-4118-992a-7450ba747835 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:55.740757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0078b-1315-4118-992a-7450ba747835 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:55.741033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0078b-1315-4118-992a-7450ba747835 None admin] PATH_INFO: `/v3/roles/961dfd3ce0344659aaf2e9c80164893e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:55.742535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0078b-1315-4118-992a-7450ba747835 None admin] RBAC: Authorizing `identity:get_role(role_id=961dfd3ce0344659aaf2e9c80164893e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:55.743916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0078b-1315-4118-992a-7450ba747835 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:55.745323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 560/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:55 2022] GET /identity/v3/roles/961dfd3ce0344659aaf2e9c80164893e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:55.752468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa066-6690-4ece-bc56-d2c06a475973 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:55.847878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa066-6690-4ece-bc56-d2c06a475973 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:55.856611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:55.881341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209e44-dd87-4137-97b3-824eae7a3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:55.882293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209e44-dd87-4137-97b3-824eae7a3b8a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:55.882580 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209e44-dd87-4137-97b3-824eae7a3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:55.882855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209e44-dd87-4137-97b3-824eae7a3b8a None admin] PATH_INFO: `/v3/users/26454bb4e06246bea1195a7311587f17` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:55.884031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5209e44-dd87-4137-97b3-824eae7a3b8a None admin] RBAC: Authorizing `identity:get_user(user_id=26454bb4e06246bea1195a7311587f17)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:55.885487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5209e44-dd87-4137-97b3-824eae7a3b8a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:55.887158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 567/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:57:55 2022] GET /identity/v3/users/26454bb4e06246bea1195a7311587f17 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:55.892822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0078b-1315-4118-992a-7450ba747835 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:55.989698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0078b-1315-4118-992a-7450ba747835 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:56.014406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:56.022680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac88e1-f803-4733-a641-e39d17e475b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:56.024654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac88e1-f803-4733-a641-e39d17e475b1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:56.024654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac88e1-f803-4733-a641-e39d17e475b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:56.024654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac88e1-f803-4733-a641-e39d17e475b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:56.088753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac88e1-f803-4733-a641-e39d17e475b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:56.090262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac88e1-f803-4733-a641-e39d17e475b1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:56.193935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 561/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:57:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:57:56.199595 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209e44-dd87-4137-97b3-824eae7a3b8a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:56.294731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209e44-dd87-4137-97b3-824eae7a3b8a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:56.327840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327eb1a6-aa62-494a-91ce-a5a900d667f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:56.328675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb1a6-aa62-494a-91ce-a5a900d667f6 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:56.328956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb1a6-aa62-494a-91ce-a5a900d667f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:56.329228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb1a6-aa62-494a-91ce-a5a900d667f6 None admin] PATH_INFO: `/v3/projects/2861a75127144308b28630ed0486bd1c` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:56.330416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327eb1a6-aa62-494a-91ce-a5a900d667f6 None admin] RBAC: Authorizing `identity:get_project(project_id=2861a75127144308b28630ed0486bd1c)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:56.331837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327eb1a6-aa62-494a-91ce-a5a900d667f6 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:56.333476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 568/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:57:56 2022] GET /identity/v3/projects/2861a75127144308b28630ed0486bd1c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:56.339309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac88e1-f803-4733-a641-e39d17e475b1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:56.365772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:56.434145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac88e1-f803-4733-a641-e39d17e475b1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:56.466332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c5cf4-1b32-4736-b72b-4cd3875d2fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:56.466970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5cf4-1b32-4736-b72b-4cd3875d2fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:56.467255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5cf4-1b32-4736-b72b-4cd3875d2fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:56.467528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5cf4-1b32-4736-b72b-4cd3875d2fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:56.468871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c5cf4-1b32-4736-b72b-4cd3875d2fb5 None admin] RBAC: Adding query filter params (role.id=961dfd3ce0344659aaf2e9c80164893e, scope.project.id=2861a75127144308b28630ed0486bd1c, user.id=26454bb4e06246bea1195a7311587f17) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:57:56.469178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c5cf4-1b32-4736-b72b-4cd3875d2fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:56.470637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c5cf4-1b32-4736-b72b-4cd3875d2fb5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:56.476263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 562/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:57:56 2022] GET /identity/v3/role_assignments?user.id=26454bb4e06246bea1195a7311587f17&scope.project.id=2861a75127144308b28630ed0486bd1c&role.id=961dfd3ce0344659aaf2e9c80164893e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:58.700947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa0f5-1544-4512-b5fb-f680ed13d402 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:58.701465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa0f5-1544-4512-b5fb-f680ed13d402 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:58.701587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa0f5-1544-4512-b5fb-f680ed13d402 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:58.702946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 569/1131] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:57:58.708219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64a0e1-c3c1-47fb-ac45-84a9599133a0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:58.708579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64a0e1-c3c1-47fb-ac45-84a9599133a0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:58.708794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64a0e1-c3c1-47fb-ac45-84a9599133a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:58.725572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-eb64a0e1-c3c1-47fb-ac45-84a9599133a0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:57:58.726781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-eb64a0e1-c3c1-47fb-ac45-84a9599133a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:57:58.791050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 563/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:57:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:57:58.815291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa0f5-1544-4512-b5fb-f680ed13d402 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:58.860852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:58.912677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa0f5-1544-4512-b5fb-f680ed13d402 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:58.944791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbce715-301b-48e6-9ba9-44d2a3f7ca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:58.945575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce715-301b-48e6-9ba9-44d2a3f7ca97 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:58.945867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce715-301b-48e6-9ba9-44d2a3f7ca97 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:58.946181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce715-301b-48e6-9ba9-44d2a3f7ca97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:58.947352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbce715-301b-48e6-9ba9-44d2a3f7ca97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:58.948788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbce715-301b-48e6-9ba9-44d2a3f7ca97 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:58.950429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 570/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:57:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:57:58.956646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64a0e1-c3c1-47fb-ac45-84a9599133a0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:57:58.977536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:57:59.052531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64a0e1-c3c1-47fb-ac45-84a9599133a0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:57:59.085015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77549-1026-4581-847c-bc7a15fdb4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:57:59.085655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77549-1026-4581-847c-bc7a15fdb4bf None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:57:59.085937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77549-1026-4581-847c-bc7a15fdb4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:57:59.086245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77549-1026-4581-847c-bc7a15fdb4bf None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:57:59.086948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b77549-1026-4581-847c-bc7a15fdb4bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:57:59.088368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b77549-1026-4581-847c-bc7a15fdb4bf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:57:59.172099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 564/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:57:58 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:58:01.416157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b61d7b-fcd8-4548-829d-731095113c4a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:01.416715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b61d7b-fcd8-4548-829d-731095113c4a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:01.416715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b61d7b-fcd8-4548-829d-731095113c4a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:01.418114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 571/1135] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:01.423781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52a7b-46fb-4282-a81e-85ca9638fe81 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:01.424156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52a7b-46fb-4282-a81e-85ca9638fe81 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:01.424341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52a7b-46fb-4282-a81e-85ca9638fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:01.441348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-dec52a7b-46fb-4282-a81e-85ca9638fe81 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:01.442813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dec52a7b-46fb-4282-a81e-85ca9638fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:01.507116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 565/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:01.531639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b61d7b-fcd8-4548-829d-731095113c4a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:01.628799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b61d7b-fcd8-4548-829d-731095113c4a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:01.641271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:01.661541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a894480-df47-4a5e-844f-ec8102ed0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:01.662350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a894480-df47-4a5e-844f-ec8102ed0d5c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:01.662648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a894480-df47-4a5e-844f-ec8102ed0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:01.662923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a894480-df47-4a5e-844f-ec8102ed0d5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:01.664085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a894480-df47-4a5e-844f-ec8102ed0d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:01.665515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a894480-df47-4a5e-844f-ec8102ed0d5c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:01.667181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 572/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:58:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:01.673333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec52a7b-46fb-4282-a81e-85ca9638fe81 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:01.675510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:01.769636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec52a7b-46fb-4282-a81e-85ca9638fe81 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:01.804162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80e21b-8cbf-4f90-b0fa-03240eebad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:01.804832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80e21b-8cbf-4f90-b0fa-03240eebad6f None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:01.805122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80e21b-8cbf-4f90-b0fa-03240eebad6f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:01.805400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80e21b-8cbf-4f90-b0fa-03240eebad6f None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:01.806159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80e21b-8cbf-4f90-b0fa-03240eebad6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:01.807599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80e21b-8cbf-4f90-b0fa-03240eebad6f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:01.885328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 566/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:58:01 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:58:04.134117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c40bb-f1e3-4da5-a21b-f198bd225bb6 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:04.134626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c40bb-f1e3-4da5-a21b-f198bd225bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:04.134626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c40bb-f1e3-4da5-a21b-f198bd225bb6 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:04.135988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 573/1139] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:04.141641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d097c6-85ad-464f-ae45-0bcda3bfabc3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:04.146994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d097c6-85ad-464f-ae45-0bcda3bfabc3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:04.146994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d097c6-85ad-464f-ae45-0bcda3bfabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:04.159441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-24d097c6-85ad-464f-ae45-0bcda3bfabc3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:04.160609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-24d097c6-85ad-464f-ae45-0bcda3bfabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:04.212567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:04.225881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 567/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:04.249213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c40bb-f1e3-4da5-a21b-f198bd225bb6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:04.347836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c40bb-f1e3-4da5-a21b-f198bd225bb6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:04.379587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f31ce-50f0-4b90-9075-a2394ed7e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:04.380360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f31ce-50f0-4b90-9075-a2394ed7e834 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:04.380647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f31ce-50f0-4b90-9075-a2394ed7e834 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:04.380924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f31ce-50f0-4b90-9075-a2394ed7e834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:04.391211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f31ce-50f0-4b90-9075-a2394ed7e834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-a21f31ce-50f0-4b90-9075-a2394ed7e834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:58:04.398801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:58:04.399900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:04.401007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:58:04.402103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 574/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:58:04.406333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d097c6-85ad-464f-ae45-0bcda3bfabc3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:04.500967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d097c6-85ad-464f-ae45-0bcda3bfabc3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:04.533457 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:04.534136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:04.534424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:04.534697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:04.535429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:04.535729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:04.537108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:04.544832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 568/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:04.550437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f31ce-50f0-4b90-9075-a2394ed7e834 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:04.591755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:04.647265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f31ce-50f0-4b90-9075-a2394ed7e834 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:04.678956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69974e-73d0-4f78-b830-e26831d40051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:04.679807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69974e-73d0-4f78-b830-e26831d40051 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:04.680094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69974e-73d0-4f78-b830-e26831d40051 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:04.680375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69974e-73d0-4f78-b830-e26831d40051 None admin] PATH_INFO: `/v3/users/1c09686bfb6f46509a17ce76d563f6d1` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:04.693875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69974e-73d0-4f78-b830-e26831d40051 None admin] RBAC: Authorizing `identity:get_user(user_id=1c09686bfb6f46509a17ce76d563f6d1)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:04.695507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69974e-73d0-4f78-b830-e26831d40051 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:04.697133 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 575/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:58:04 2022] GET /identity/v3/users/1c09686bfb6f46509a17ce76d563f6d1 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:04.703252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:04.753718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:04.802070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24c975-47a6-4fef-a00b-d566462e1cd5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:04.835062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649703ff-5d9a-4345-8275-00bbe11b906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:04.835705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649703ff-5d9a-4345-8275-00bbe11b906d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:04.835995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649703ff-5d9a-4345-8275-00bbe11b906d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:04.836276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649703ff-5d9a-4345-8275-00bbe11b906d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:04.900661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649703ff-5d9a-4345-8275-00bbe11b906d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:04.902078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649703ff-5d9a-4345-8275-00bbe11b906d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:04.948043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:04.995575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 569/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:58:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:58:05.002190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69974e-73d0-4f78-b830-e26831d40051 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:05.093785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:05.097260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69974e-73d0-4f78-b830-e26831d40051 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:05.130609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ded944-2ef1-48f2-a740-958bfdd52e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:05.131455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded944-2ef1-48f2-a740-958bfdd52e4e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:05.131734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded944-2ef1-48f2-a740-958bfdd52e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:05.132004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded944-2ef1-48f2-a740-958bfdd52e4e None admin] PATH_INFO: `/v3/projects/d1a3f19c037543cca830c5487012c053` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:05.133156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded944-2ef1-48f2-a740-958bfdd52e4e None admin] RBAC: Authorizing `identity:get_project(project_id=d1a3f19c037543cca830c5487012c053)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:05.134618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded944-2ef1-48f2-a740-958bfdd52e4e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:05.136276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 576/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:58:05 2022] GET /identity/v3/projects/d1a3f19c037543cca830c5487012c053 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:05.142401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649703ff-5d9a-4345-8275-00bbe11b906d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:05.238023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649703ff-5d9a-4345-8275-00bbe11b906d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:05.270151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f7bb8-ea61-4fdd-b024-ab6179f7c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:05.270790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7bb8-ea61-4fdd-b024-ab6179f7c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:05.271076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7bb8-ea61-4fdd-b024-ab6179f7c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:05.271351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f7bb8-ea61-4fdd-b024-ab6179f7c1ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:05.272174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f7bb8-ea61-4fdd-b024-ab6179f7c1ee None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=d1a3f19c037543cca830c5487012c053, user.id=1c09686bfb6f46509a17ce76d563f6d1) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:05.272484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f7bb8-ea61-4fdd-b024-ab6179f7c1ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:05.273907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f7bb8-ea61-4fdd-b024-ab6179f7c1ee None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:05.279189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 570/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:58:05 2022] GET /identity/v3/role_assignments?user.id=1c09686bfb6f46509a17ce76d563f6d1&scope.project.id=d1a3f19c037543cca830c5487012c053&role.id=f3f138e4021a4b7dada39089dd427266 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:07.477182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5c9a-1236-49d5-8c6c-80f66ff8ebd3 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:07.477702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5c9a-1236-49d5-8c6c-80f66ff8ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:07.477822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5c9a-1236-49d5-8c6c-80f66ff8ebd3 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:07.479154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 577/1147] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:07.484400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69767559-0ee0-4412-8cb5-ce3897e6e0f7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:07.484822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69767559-0ee0-4412-8cb5-ce3897e6e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:07.484940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69767559-0ee0-4412-8cb5-ce3897e6e0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:07.501690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-69767559-0ee0-4412-8cb5-ce3897e6e0f7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:07.502913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-69767559-0ee0-4412-8cb5-ce3897e6e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:07.511796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:07.567890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 571/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:07.590746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba5c9a-1236-49d5-8c6c-80f66ff8ebd3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:07.688660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba5c9a-1236-49d5-8c6c-80f66ff8ebd3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:07.721275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153d063-af47-41a5-bff8-9e3427f2f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:07.722070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153d063-af47-41a5-bff8-9e3427f2f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:07.722358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153d063-af47-41a5-bff8-9e3427f2f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:07.722636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153d063-af47-41a5-bff8-9e3427f2f2c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:07.732513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153d063-af47-41a5-bff8-9e3427f2f2c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-0153d063-af47-41a5-bff8-9e3427f2f2c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:58:07.740050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:58:07.741130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:58:07.742411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 578/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:58:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:58:07.747155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69767559-0ee0-4412-8cb5-ce3897e6e0f7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:07.842276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69767559-0ee0-4412-8cb5-ce3897e6e0f7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:07.874967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:07.875621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:07.875902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:07.876176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:07.876912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:07.877213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:07.878618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:07.886321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 572/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:58:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:07.892132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153d063-af47-41a5-bff8-9e3427f2f2c9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:07.918872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:07.989655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153d063-af47-41a5-bff8-9e3427f2f2c9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:08.023074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab87f57-3e47-4db8-b36f-da98562d3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:08.023943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab87f57-3e47-4db8-b36f-da98562d3933 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:08.024229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab87f57-3e47-4db8-b36f-da98562d3933 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:08.024503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab87f57-3e47-4db8-b36f-da98562d3933 None admin] PATH_INFO: `/v3/users/1c09686bfb6f46509a17ce76d563f6d1` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:08.025676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab87f57-3e47-4db8-b36f-da98562d3933 None admin] RBAC: Authorizing `identity:get_user(user_id=1c09686bfb6f46509a17ce76d563f6d1)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:08.027152 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab87f57-3e47-4db8-b36f-da98562d3933 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:08.028736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 579/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:58:07 2022] GET /identity/v3/users/1c09686bfb6f46509a17ce76d563f6d1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:08.034348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:08.043216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:08.130254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d9e3b-62df-4b5c-a6ec-d961b50cc0c5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:08.161269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9292e-0ae7-4392-aee2-549c92cb8b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:08.162138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9292e-0ae7-4392-aee2-549c92cb8b28 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:08.162423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9292e-0ae7-4392-aee2-549c92cb8b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:08.162699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9292e-0ae7-4392-aee2-549c92cb8b28 None admin] PATH_INFO: `/v3/projects/d1a3f19c037543cca830c5487012c053` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:08.163850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9292e-0ae7-4392-aee2-549c92cb8b28 None admin] RBAC: Authorizing `identity:get_project(project_id=d1a3f19c037543cca830c5487012c053)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:08.165266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9292e-0ae7-4392-aee2-549c92cb8b28 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:08.166926 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 573/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:58:08 2022] GET /identity/v3/projects/d1a3f19c037543cca830c5487012c053 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:08.173225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab87f57-3e47-4db8-b36f-da98562d3933 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:08.263514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:08.269841 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab87f57-3e47-4db8-b36f-da98562d3933 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:08.303329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1e105-99de-4a38-acea-e25cd5f8056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:08.304202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1e105-99de-4a38-acea-e25cd5f8056c None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:08.304491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1e105-99de-4a38-acea-e25cd5f8056c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:08.304773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1e105-99de-4a38-acea-e25cd5f8056c None admin] PATH_INFO: `/v3/projects/d1a3f19c037543cca830c5487012c053/users/1c09686bfb6f46509a17ce76d563f6d1/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:08.306734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1e105-99de-4a38-acea-e25cd5f8056c None admin] RBAC: Authorizing `identity:create_grant(project_id=d1a3f19c037543cca830c5487012c053, user_id=1c09686bfb6f46509a17ce76d563f6d1, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:08.308163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1e105-99de-4a38-acea-e25cd5f8056c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:08.353549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 580/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:58:08 2022] PUT /identity/v3/projects/d1a3f19c037543cca830c5487012c053/users/1c09686bfb6f46509a17ce76d563f6d1/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:58:10.531681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526502a-c1d7-4196-a29f-eb29f7f667cd None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:10.532302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526502a-c1d7-4196-a29f-eb29f7f667cd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:10.532302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526502a-c1d7-4196-a29f-eb29f7f667cd None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:10.533582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 574/1154] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:10.538882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0427c2-e3da-4a36-9d01-e6a5724ca769 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:10.539328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0427c2-e3da-4a36-9d01-e6a5724ca769 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:10.539439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0427c2-e3da-4a36-9d01-e6a5724ca769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:10.556785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2b0427c2-e3da-4a36-9d01-e6a5724ca769 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:10.558000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2b0427c2-e3da-4a36-9d01-e6a5724ca769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:10.622286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 581/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:10.645169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526502a-c1d7-4196-a29f-eb29f7f667cd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:10.718108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:10.743412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526502a-c1d7-4196-a29f-eb29f7f667cd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:10.775386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103f65-a7aa-4106-9ceb-275977a3df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:10.776171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103f65-a7aa-4106-9ceb-275977a3df20 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:10.776456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103f65-a7aa-4106-9ceb-275977a3df20 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:10.776732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103f65-a7aa-4106-9ceb-275977a3df20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:10.787048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71103f65-a7aa-4106-9ceb-275977a3df20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-71103f65-a7aa-4106-9ceb-275977a3df20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:58:10.794666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:58:10.796437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:58:10.797543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 575/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:58:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:58:10.802463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0427c2-e3da-4a36-9d01-e6a5724ca769 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:10.882125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:10.897482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0427c2-e3da-4a36-9d01-e6a5724ca769 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:10.930501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:10.931158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:10.931448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:10.931731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:10.932477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:10.932786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:10.934185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:10.942256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 582/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:10.947867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103f65-a7aa-4106-9ceb-275977a3df20 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:11.044777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103f65-a7aa-4106-9ceb-275977a3df20 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:11.077478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7828c84-5bf9-4b33-a57d-b52722aa592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:11.078356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7828c84-5bf9-4b33-a57d-b52722aa592e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:11.078639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7828c84-5bf9-4b33-a57d-b52722aa592e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:11.078911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7828c84-5bf9-4b33-a57d-b52722aa592e None admin] PATH_INFO: `/v3/users/1c09686bfb6f46509a17ce76d563f6d1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:11.080085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7828c84-5bf9-4b33-a57d-b52722aa592e None admin] RBAC: Authorizing `identity:get_user(user_id=1c09686bfb6f46509a17ce76d563f6d1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:11.081516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7828c84-5bf9-4b33-a57d-b52722aa592e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:11.083119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 576/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:58:10 2022] GET /identity/v3/users/1c09686bfb6f46509a17ce76d563f6d1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:11.088688 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:11.185230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c229865-1fad-491a-835d-c82fe0c6a02b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:11.218344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43750aa5-2e9d-44a7-a7eb-73827e19d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:11.218979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750aa5-2e9d-44a7-a7eb-73827e19d32d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:11.219268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750aa5-2e9d-44a7-a7eb-73827e19d32d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:11.219546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43750aa5-2e9d-44a7-a7eb-73827e19d32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:11.234622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:11.284754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43750aa5-2e9d-44a7-a7eb-73827e19d32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:11.286249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43750aa5-2e9d-44a7-a7eb-73827e19d32d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:11.380561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 583/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:58:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:58:11.386274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7828c84-5bf9-4b33-a57d-b52722aa592e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:11.389734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:11.483352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7828c84-5bf9-4b33-a57d-b52722aa592e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:11.515822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3401a5-aaf3-49bb-9fbd-8aa4fffa3939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:11.516664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3401a5-aaf3-49bb-9fbd-8aa4fffa3939 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:11.516951 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3401a5-aaf3-49bb-9fbd-8aa4fffa3939 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:11.517229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3401a5-aaf3-49bb-9fbd-8aa4fffa3939 None admin] PATH_INFO: `/v3/projects/d1a3f19c037543cca830c5487012c053` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:11.518423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3401a5-aaf3-49bb-9fbd-8aa4fffa3939 None admin] RBAC: Authorizing `identity:get_project(project_id=d1a3f19c037543cca830c5487012c053)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:11.519856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3401a5-aaf3-49bb-9fbd-8aa4fffa3939 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:11.521512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 577/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:58:11 2022] GET /identity/v3/projects/d1a3f19c037543cca830c5487012c053 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:11.527569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43750aa5-2e9d-44a7-a7eb-73827e19d32d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:11.572094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:11.625516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43750aa5-2e9d-44a7-a7eb-73827e19d32d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:11.664655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47144343-c4e4-4e10-aa71-28110b543da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:11.665234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144343-c4e4-4e10-aa71-28110b543da2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:11.665520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144343-c4e4-4e10-aa71-28110b543da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:11.665803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47144343-c4e4-4e10-aa71-28110b543da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:11.666665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144343-c4e4-4e10-aa71-28110b543da2 None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=d1a3f19c037543cca830c5487012c053, user.id=1c09686bfb6f46509a17ce76d563f6d1) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:11.666983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144343-c4e4-4e10-aa71-28110b543da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:11.668545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47144343-c4e4-4e10-aa71-28110b543da2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:11.675259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 584/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:58:11 2022] GET /identity/v3/role_assignments?user.id=1c09686bfb6f46509a17ce76d563f6d1&scope.project.id=d1a3f19c037543cca830c5487012c053&role.id=f3f138e4021a4b7dada39089dd427266 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:13.945493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0c7fe-dc4e-4930-9da3-8b52bf281d6d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:13.946024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0c7fe-dc4e-4930-9da3-8b52bf281d6d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:13.946147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0c7fe-dc4e-4930-9da3-8b52bf281d6d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:13.947481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 578/1162] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:13.952622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872ee8-3a24-4f04-9a75-c13081ca7ef2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:13.953047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872ee8-3a24-4f04-9a75-c13081ca7ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:13.953190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18872ee8-3a24-4f04-9a75-c13081ca7ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:13.969443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-18872ee8-3a24-4f04-9a75-c13081ca7ef2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:13.970654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-18872ee8-3a24-4f04-9a75-c13081ca7ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:14.034584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 585/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:14.057069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0c7fe-dc4e-4930-9da3-8b52bf281d6d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:14.125756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:14.155803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0c7fe-dc4e-4930-9da3-8b52bf281d6d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:14.189176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39af10-71ab-45e1-83b9-6850d52df568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:14.189809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39af10-71ab-45e1-83b9-6850d52df568 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:14.190124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39af10-71ab-45e1-83b9-6850d52df568 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:14.190405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39af10-71ab-45e1-83b9-6850d52df568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:14.255544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39af10-71ab-45e1-83b9-6850d52df568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:14.257003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39af10-71ab-45e1-83b9-6850d52df568 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:14.321054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:14.351073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 579/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:58:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 30 11:58:14.356939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18872ee8-3a24-4f04-9a75-c13081ca7ef2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:14.396139 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:14.451552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18872ee8-3a24-4f04-9a75-c13081ca7ef2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:14.484428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b407fe-7f52-4bb5-b469-802ba1f284d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:14.485207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b407fe-7f52-4bb5-b469-802ba1f284d2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:14.485488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b407fe-7f52-4bb5-b469-802ba1f284d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:14.485760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b407fe-7f52-4bb5-b469-802ba1f284d2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:14.492223 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b407fe-7f52-4bb5-b469-802ba1f284d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:14.493648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b407fe-7f52-4bb5-b469-802ba1f284d2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-92b407fe-7f52-4bb5-b469-802ba1f284d2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:58:14.507352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:58:14.508408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:58:14.509330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 586/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 11:58:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:58:14.514266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39af10-71ab-45e1-83b9-6850d52df568 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:14.609423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39af10-71ab-45e1-83b9-6850d52df568 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:14.641675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153cb3c-a066-42be-ab48-a894a476ee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:14.642350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153cb3c-a066-42be-ab48-a894a476ee27 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:14.642636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153cb3c-a066-42be-ab48-a894a476ee27 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:14.642912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153cb3c-a066-42be-ab48-a894a476ee27 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:14.643624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153cb3c-a066-42be-ab48-a894a476ee27 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:14.643929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153cb3c-a066-42be-ab48-a894a476ee27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:14.645287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153cb3c-a066-42be-ab48-a894a476ee27 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:14.652221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 580/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 30 11:58:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:16.873410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7903a-c063-450c-a518-451e4843c728 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:16.873943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7903a-c063-450c-a518-451e4843c728 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:16.873943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7903a-c063-450c-a518-451e4843c728 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:16.875378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 587/1167] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:16.880638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c4283-9457-4621-b42c-7995f6d40bc0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:16.881039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c4283-9457-4621-b42c-7995f6d40bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:16.881205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c4283-9457-4621-b42c-7995f6d40bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:16.898032 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0a7c4283-9457-4621-b42c-7995f6d40bc0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:16.899233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0a7c4283-9457-4621-b42c-7995f6d40bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:16.925372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:16.964246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 581/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:16.987291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7903a-c063-450c-a518-451e4843c728 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:17.083554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:17.087018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7903a-c063-450c-a518-451e4843c728 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:17.119855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fd0dc-7315-4e77-93b9-09eeafdae59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:17.120500 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fd0dc-7315-4e77-93b9-09eeafdae59c None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:17.120782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fd0dc-7315-4e77-93b9-09eeafdae59c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:17.121055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fd0dc-7315-4e77-93b9-09eeafdae59c None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:17.121785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fd0dc-7315-4e77-93b9-09eeafdae59c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:17.123177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fd0dc-7315-4e77-93b9-09eeafdae59c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:17.224033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 588/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Mon May 30 11:58:16 2022] POST /identity/v3/domains => generated 267 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:58:19.455355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1de4-05b1-49c0-b59e-4306da80fb99 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:19.455877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1de4-05b1-49c0-b59e-4306da80fb99 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:19.455985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1de4-05b1-49c0-b59e-4306da80fb99 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:19.457264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 582/1170] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:19.462558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58564a-ff5e-4eb4-b51e-6e04ccfcb76b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:19.462943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58564a-ff5e-4eb4-b51e-6e04ccfcb76b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:19.463121 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58564a-ff5e-4eb4-b51e-6e04ccfcb76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:19.480504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-1b58564a-ff5e-4eb4-b51e-6e04ccfcb76b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:19.481685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1b58564a-ff5e-4eb4-b51e-6e04ccfcb76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:19.545792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 589/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:19.569846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1de4-05b1-49c0-b59e-4306da80fb99 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:19.666610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1de4-05b1-49c0-b59e-4306da80fb99 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:19.698864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917c29c-bdd9-40c7-9958-040aa3d6316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:19.699698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c29c-bdd9-40c7-9958-040aa3d6316a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:19.699979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c29c-bdd9-40c7-9958-040aa3d6316a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:19.700251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c29c-bdd9-40c7-9958-040aa3d6316a None admin] PATH_INFO: `/v3/domains/05081895eb634c5bac3ecce5f328f110` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:19.710772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917c29c-bdd9-40c7-9958-040aa3d6316a None admin] RBAC: Authorizing `identity:get_domain(domain_id=05081895eb634c5bac3ecce5f328f110)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:19.712155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917c29c-bdd9-40c7-9958-040aa3d6316a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:19.713729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 583/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 30 11:58:19 2022] GET /identity/v3/domains/05081895eb634c5bac3ecce5f328f110 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:19.719387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58564a-ff5e-4eb4-b51e-6e04ccfcb76b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:19.806317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:19.816285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58564a-ff5e-4eb4-b51e-6e04ccfcb76b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:19.848596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba77c9-a4a9-4e90-988c-77fe8fe5cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:19.849270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba77c9-a4a9-4e90-988c-77fe8fe5cb25 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:19.849581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba77c9-a4a9-4e90-988c-77fe8fe5cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:19.850089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba77c9-a4a9-4e90-988c-77fe8fe5cb25 None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:19.851006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba77c9-a4a9-4e90-988c-77fe8fe5cb25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:19.852563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba77c9-a4a9-4e90-988c-77fe8fe5cb25 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:19.937817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 590/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 11:58:19 2022] POST /identity/v3/projects => generated 361 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:58:22.197491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888cecf-49d5-4434-adcf-595f91eaadbd None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:22.198014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888cecf-49d5-4434-adcf-595f91eaadbd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:22.198014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888cecf-49d5-4434-adcf-595f91eaadbd None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:22.199381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 584/1174] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:22.205080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d3be-d985-4259-a633-b0cb9be2d85c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:22.205490 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d3be-d985-4259-a633-b0cb9be2d85c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:22.205650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129d3be-d985-4259-a633-b0cb9be2d85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:22.222667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f129d3be-d985-4259-a633-b0cb9be2d85c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:22.223849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f129d3be-d985-4259-a633-b0cb9be2d85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:22.288179 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 591/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:22.312403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888cecf-49d5-4434-adcf-595f91eaadbd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:22.337865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:22.411699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888cecf-49d5-4434-adcf-595f91eaadbd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:22.443637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adab50-9a9d-47b2-87f7-53bd7e29214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:22.444476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adab50-9a9d-47b2-87f7-53bd7e29214d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:22.444761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adab50-9a9d-47b2-87f7-53bd7e29214d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:22.445037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adab50-9a9d-47b2-87f7-53bd7e29214d None admin] PATH_INFO: `/v3/domains/05081895eb634c5bac3ecce5f328f110` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:22.446237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adab50-9a9d-47b2-87f7-53bd7e29214d None admin] RBAC: Authorizing `identity:get_domain(domain_id=05081895eb634c5bac3ecce5f328f110)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:22.447720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adab50-9a9d-47b2-87f7-53bd7e29214d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:22.449245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 585/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 30 11:58:22 2022] GET /identity/v3/domains/05081895eb634c5bac3ecce5f328f110 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:22.455326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129d3be-d985-4259-a633-b0cb9be2d85c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:22.522577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:22.550269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129d3be-d985-4259-a633-b0cb9be2d85c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:22.583948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e90ba-ca84-4337-a1ec-52af92501547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:22.584603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e90ba-ca84-4337-a1ec-52af92501547 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:22.584888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e90ba-ca84-4337-a1ec-52af92501547 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:22.585167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e90ba-ca84-4337-a1ec-52af92501547 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:22.585876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e90ba-ca84-4337-a1ec-52af92501547 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:22.587339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e90ba-ca84-4337-a1ec-52af92501547 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:22.650100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 592/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:58:22 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 11:58:24.925367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a102070-4aba-4225-83ad-8f5d9ee8079d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:24.925862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a102070-4aba-4225-83ad-8f5d9ee8079d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:24.926010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a102070-4aba-4225-83ad-8f5d9ee8079d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:24.927321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 586/1178] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:24.932633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c5440-a93c-4b13-bd3c-0ad197f7b4f7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:24.933062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c5440-a93c-4b13-bd3c-0ad197f7b4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:24.933191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c5440-a93c-4b13-bd3c-0ad197f7b4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:24.949652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-067c5440-a93c-4b13-bd3c-0ad197f7b4f7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:24.950845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-067c5440-a93c-4b13-bd3c-0ad197f7b4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:25.015350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 593/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:25.039194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a102070-4aba-4225-83ad-8f5d9ee8079d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:25.130652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:25.140419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a102070-4aba-4225-83ad-8f5d9ee8079d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:25.173360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c26b-09ac-4153-8470-b9be4e3e7d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:25.174198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c26b-09ac-4153-8470-b9be4e3e7d76 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:25.174483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c26b-09ac-4153-8470-b9be4e3e7d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:25.185417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c26b-09ac-4153-8470-b9be4e3e7d76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:25.185417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516c26b-09ac-4153-8470-b9be4e3e7d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e516c26b-09ac-4153-8470-b9be4e3e7d76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:58:25.192630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:58:25.193706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:58:25.194622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 587/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:58:25.199922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c5440-a93c-4b13-bd3c-0ad197f7b4f7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:25.254962 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:25.294770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c5440-a93c-4b13-bd3c-0ad197f7b4f7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:25.327398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:25.328051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:25.328331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:25.328604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:25.329338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:25.329644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:25.331047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:25.338766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 594/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:25.345262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c26b-09ac-4153-8470-b9be4e3e7d76 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:25.441149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c26b-09ac-4153-8470-b9be4e3e7d76 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:25.473606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573785a9-7399-4435-8dae-a1a48fa4a9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:25.474486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573785a9-7399-4435-8dae-a1a48fa4a9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:25.474772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573785a9-7399-4435-8dae-a1a48fa4a9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:25.475051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573785a9-7399-4435-8dae-a1a48fa4a9c6 None admin] PATH_INFO: `/v3/users/2c006d4b584548d7b3fdcfb4830f0394` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:25.487555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573785a9-7399-4435-8dae-a1a48fa4a9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=2c006d4b584548d7b3fdcfb4830f0394)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:25.489002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573785a9-7399-4435-8dae-a1a48fa4a9c6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:25.490630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 588/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:58:25 2022] GET /identity/v3/users/2c006d4b584548d7b3fdcfb4830f0394 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:25.496142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:25.593486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16091c2a-07f0-4c7f-8e4e-eefcb65faa41 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:25.612756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:25.625916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a199-5cd0-41f3-9b77-96b070056eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:25.626581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a199-5cd0-41f3-9b77-96b070056eac None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:25.626865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a199-5cd0-41f3-9b77-96b070056eac None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:25.627142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a199-5cd0-41f3-9b77-96b070056eac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:25.691437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a199-5cd0-41f3-9b77-96b070056eac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:25.692883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a199-5cd0-41f3-9b77-96b070056eac None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:25.786876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 595/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:58:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:58:25.792792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573785a9-7399-4435-8dae-a1a48fa4a9c6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:25.805208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:25.890630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573785a9-7399-4435-8dae-a1a48fa4a9c6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:25.923140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd6c6a-cb0f-43d1-bee9-fcb9003312e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:25.923985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6c6a-cb0f-43d1-bee9-fcb9003312e0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:25.924273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6c6a-cb0f-43d1-bee9-fcb9003312e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:25.924555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6c6a-cb0f-43d1-bee9-fcb9003312e0 None admin] PATH_INFO: `/v3/projects/106496c476734ef89a2726505c9811a3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:25.925723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd6c6a-cb0f-43d1-bee9-fcb9003312e0 None admin] RBAC: Authorizing `identity:get_project(project_id=106496c476734ef89a2726505c9811a3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:25.927205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd6c6a-cb0f-43d1-bee9-fcb9003312e0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:25.928878 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 589/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:58:25 2022] GET /identity/v3/projects/106496c476734ef89a2726505c9811a3 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:25.934891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a199-5cd0-41f3-9b77-96b070056eac None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:25.955871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:26.031578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a199-5cd0-41f3-9b77-96b070056eac None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:26.063366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9042b7-2c03-40bf-9cac-c4b48d3a4cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:26.064008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9042b7-2c03-40bf-9cac-c4b48d3a4cce None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:26.064290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9042b7-2c03-40bf-9cac-c4b48d3a4cce None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:26.064565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9042b7-2c03-40bf-9cac-c4b48d3a4cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:26.065636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9042b7-2c03-40bf-9cac-c4b48d3a4cce None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=106496c476734ef89a2726505c9811a3, user.id=2c006d4b584548d7b3fdcfb4830f0394) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:26.065947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9042b7-2c03-40bf-9cac-c4b48d3a4cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:26.067394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9042b7-2c03-40bf-9cac-c4b48d3a4cce None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:26.072633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 596/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:58:25 2022] GET /identity/v3/role_assignments?user.id=2c006d4b584548d7b3fdcfb4830f0394&scope.project.id=106496c476734ef89a2726505c9811a3&role.id=f3f138e4021a4b7dada39089dd427266 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:28.277656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778adcb-23d3-4b7c-a1a0-640df0ba18ed None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:28.278201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778adcb-23d3-4b7c-a1a0-640df0ba18ed None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:28.278923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778adcb-23d3-4b7c-a1a0-640df0ba18ed None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:28.280281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 590/1186] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:28.285582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7e6c-ed55-46e7-b1c4-b07552bf9c3e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:28.285988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7e6c-ed55-46e7-b1c4-b07552bf9c3e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:28.286175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7e6c-ed55-46e7-b1c4-b07552bf9c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:28.302429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-929c7e6c-ed55-46e7-b1c4-b07552bf9c3e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:28.303602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-929c7e6c-ed55-46e7-b1c4-b07552bf9c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:28.367596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 597/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:28.390553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778adcb-23d3-4b7c-a1a0-640df0ba18ed None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:28.468033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:28.489266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778adcb-23d3-4b7c-a1a0-640df0ba18ed None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:28.523206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35ed4b-94b0-4c53-b46c-6d631f7e13db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:28.523984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35ed4b-94b0-4c53-b46c-6d631f7e13db None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:28.524271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35ed4b-94b0-4c53-b46c-6d631f7e13db None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:28.524546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35ed4b-94b0-4c53-b46c-6d631f7e13db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:28.534378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35ed4b-94b0-4c53-b46c-6d631f7e13db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0f35ed4b-94b0-4c53-b46c-6d631f7e13db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:58:28.541930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:58:28.543051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:58:28.544243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 591/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:58:28.549057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7e6c-ed55-46e7-b1c4-b07552bf9c3e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:28.564063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:28.645915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7e6c-ed55-46e7-b1c4-b07552bf9c3e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:28.677943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:28.678630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:28.678931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:28.679210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:28.679950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:28.680261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:28.681649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:28.689935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 598/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:28.696151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35ed4b-94b0-4c53-b46c-6d631f7e13db None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:28.793328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35ed4b-94b0-4c53-b46c-6d631f7e13db None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:28.826439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d9e9-4e4a-457e-b894-3b2ef1c38a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:28.827302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d9e9-4e4a-457e-b894-3b2ef1c38a1c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:28.827589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d9e9-4e4a-457e-b894-3b2ef1c38a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:28.827867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d9e9-4e4a-457e-b894-3b2ef1c38a1c None admin] PATH_INFO: `/v3/users/2c006d4b584548d7b3fdcfb4830f0394` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:28.829045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8d9e9-4e4a-457e-b894-3b2ef1c38a1c None admin] RBAC: Authorizing `identity:get_user(user_id=2c006d4b584548d7b3fdcfb4830f0394)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:28.830511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8d9e9-4e4a-457e-b894-3b2ef1c38a1c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:28.832126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 592/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:58:28 2022] GET /identity/v3/users/2c006d4b584548d7b3fdcfb4830f0394 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:28.837793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:28.912377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:28.934351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec2abc-0633-48d6-a55f-a654a6c1d863 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:28.966859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99613c35-6958-424f-9bce-28046cc88cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:28.967698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613c35-6958-424f-9bce-28046cc88cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:28.967982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613c35-6958-424f-9bce-28046cc88cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:28.968258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613c35-6958-424f-9bce-28046cc88cb8 None admin] PATH_INFO: `/v3/projects/106496c476734ef89a2726505c9811a3` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:28.969412 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99613c35-6958-424f-9bce-28046cc88cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=106496c476734ef89a2726505c9811a3)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:28.970878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99613c35-6958-424f-9bce-28046cc88cb8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:28.972564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 599/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:58:28 2022] GET /identity/v3/projects/106496c476734ef89a2726505c9811a3 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 11:58:28.978400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d9e9-4e4a-457e-b894-3b2ef1c38a1c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:28.987975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:29.076713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d9e9-4e4a-457e-b894-3b2ef1c38a1c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:29.108816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f035a-5395-4a9f-884a-850c796571b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:29.109682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f035a-5395-4a9f-884a-850c796571b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:29.109993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f035a-5395-4a9f-884a-850c796571b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:29.110265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f035a-5395-4a9f-884a-850c796571b6 None admin] PATH_INFO: `/v3/projects/106496c476734ef89a2726505c9811a3/users/2c006d4b584548d7b3fdcfb4830f0394/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:29.112192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f035a-5395-4a9f-884a-850c796571b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=106496c476734ef89a2726505c9811a3, user_id=2c006d4b584548d7b3fdcfb4830f0394, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:29.113630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f035a-5395-4a9f-884a-850c796571b6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:29.163737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 593/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:58:28 2022] PUT /identity/v3/projects/106496c476734ef89a2726505c9811a3/users/2c006d4b584548d7b3fdcfb4830f0394/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:58:31.362922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f123812-7181-4473-bc9d-89fa31af83ea None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:31.363483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f123812-7181-4473-bc9d-89fa31af83ea None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:31.363483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f123812-7181-4473-bc9d-89fa31af83ea None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:31.364867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 600/1193] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:58:31.370047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811bdc8-6eeb-4ef8-bba1-39ae92d7b135 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:31.370449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811bdc8-6eeb-4ef8-bba1-39ae92d7b135 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:31.370610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811bdc8-6eeb-4ef8-bba1-39ae92d7b135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:31.386808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2811bdc8-6eeb-4ef8-bba1-39ae92d7b135 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:58:31.388485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2811bdc8-6eeb-4ef8-bba1-39ae92d7b135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:58:31.444782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:31.452395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 594/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:58:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:58:31.476256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f123812-7181-4473-bc9d-89fa31af83ea None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:31.574860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f123812-7181-4473-bc9d-89fa31af83ea None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:31.607006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958e38-8e6a-4e77-a479-9ac4ebaadb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:31.607779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958e38-8e6a-4e77-a479-9ac4ebaadb26 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:31.608064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958e38-8e6a-4e77-a479-9ac4ebaadb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:31.608344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958e38-8e6a-4e77-a479-9ac4ebaadb26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:31.618548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e958e38-8e6a-4e77-a479-9ac4ebaadb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-5e958e38-8e6a-4e77-a479-9ac4ebaadb26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:58:31.626554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:58:31.627639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:58:31.628844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 601/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 11:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:58:31.633559 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811bdc8-6eeb-4ef8-bba1-39ae92d7b135 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:31.727865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811bdc8-6eeb-4ef8-bba1-39ae92d7b135 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:31.760379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:31.761038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:31.761319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:31.761600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:31.762371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:31.763240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:31.764604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:31.772341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 595/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 11:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:31.777977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958e38-8e6a-4e77-a479-9ac4ebaadb26 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:31.781755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:31.874029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958e38-8e6a-4e77-a479-9ac4ebaadb26 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:31.907657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140e114-46d5-449e-b2eb-6d6da2fbbd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:31.908516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e114-46d5-449e-b2eb-6d6da2fbbd4d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:31.908806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e114-46d5-449e-b2eb-6d6da2fbbd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:31.909088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e114-46d5-449e-b2eb-6d6da2fbbd4d None admin] PATH_INFO: `/v3/users/2c006d4b584548d7b3fdcfb4830f0394` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:31.910293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140e114-46d5-449e-b2eb-6d6da2fbbd4d None admin] RBAC: Authorizing `identity:get_user(user_id=2c006d4b584548d7b3fdcfb4830f0394)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:31.911749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140e114-46d5-449e-b2eb-6d6da2fbbd4d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:31.913362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 602/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 30 11:58:31 2022] GET /identity/v3/users/2c006d4b584548d7b3fdcfb4830f0394 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:31.919610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:31.975336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:32.015466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f868-e586-4755-b73e-84f217302adf None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:32.048149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fca6a-ab99-4ccb-b7ba-39a7d5d19df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:32.048782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fca6a-ab99-4ccb-b7ba-39a7d5d19df5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:32.049064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fca6a-ab99-4ccb-b7ba-39a7d5d19df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:32.049337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fca6a-ab99-4ccb-b7ba-39a7d5d19df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:32.113054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fca6a-ab99-4ccb-b7ba-39a7d5d19df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:32.114512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fca6a-ab99-4ccb-b7ba-39a7d5d19df5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:32.168187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:32.211050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 596/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:58:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:58:32.217322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140e114-46d5-449e-b2eb-6d6da2fbbd4d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:32.285067 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:32.313363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140e114-46d5-449e-b2eb-6d6da2fbbd4d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:32.346794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69f1f2-c944-48c5-9dd7-9a210f3d655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:32.347635 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f1f2-c944-48c5-9dd7-9a210f3d655c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:32.347940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f1f2-c944-48c5-9dd7-9a210f3d655c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:32.348206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f1f2-c944-48c5-9dd7-9a210f3d655c None admin] PATH_INFO: `/v3/projects/106496c476734ef89a2726505c9811a3` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:32.349374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69f1f2-c944-48c5-9dd7-9a210f3d655c None admin] RBAC: Authorizing `identity:get_project(project_id=106496c476734ef89a2726505c9811a3)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:32.350890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69f1f2-c944-48c5-9dd7-9a210f3d655c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:32.352558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 603/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 30 11:58:32 2022] GET /identity/v3/projects/106496c476734ef89a2726505c9811a3 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:32.359208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fca6a-ab99-4ccb-b7ba-39a7d5d19df5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:58:32.454820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fca6a-ab99-4ccb-b7ba-39a7d5d19df5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:58:32.488319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114697a-aa47-4054-a009-9a9ce2aa9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:58:32.488964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114697a-aa47-4054-a009-9a9ce2aa9edb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:58:32.489255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114697a-aa47-4054-a009-9a9ce2aa9edb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:58:32.489537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114697a-aa47-4054-a009-9a9ce2aa9edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:58:32.490396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114697a-aa47-4054-a009-9a9ce2aa9edb None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=106496c476734ef89a2726505c9811a3, user.id=2c006d4b584548d7b3fdcfb4830f0394) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:58:32.490714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114697a-aa47-4054-a009-9a9ce2aa9edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:58:32.492157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114697a-aa47-4054-a009-9a9ce2aa9edb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:58:32.497866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 597/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:58:32 2022] GET /identity/v3/role_assignments?user.id=2c006d4b584548d7b3fdcfb4830f0394&scope.project.id=106496c476734ef89a2726505c9811a3&role.id=f3f138e4021a4b7dada39089dd427266 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:58:42.342745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=30 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:58:42.495246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:47.274407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d94f1-d986-42a3-8899-575263369eec None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:47.274981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d94f1-d986-42a3-8899-575263369eec None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:47.274981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d94f1-d986-42a3-8899-575263369eec None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:47.276350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 604/1201] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:47.281480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b814a60-9b33-4b49-b91c-444c5a8dcadf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:47.281898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b814a60-9b33-4b49-b91c-444c5a8dcadf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:47.282085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b814a60-9b33-4b49-b91c-444c5a8dcadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:47.299239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2b814a60-9b33-4b49-b91c-444c5a8dcadf None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:47.300408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2b814a60-9b33-4b49-b91c-444c5a8dcadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:47.364783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 598/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:59:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:59:47.390288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d94f1-d986-42a3-8899-575263369eec None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:47.489670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d94f1-d986-42a3-8899-575263369eec None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:47.523501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:47.524953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:47.524953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:47.524953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:47.534657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:47.536086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:59:47.552922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:47.566338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:47.567545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:59:47.567545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:59:47.567545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:47.567545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:59:47.567545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 605/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:47.567922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b814a60-9b33-4b49-b91c-444c5a8dcadf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:47.659507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b814a60-9b33-4b49-b91c-444c5a8dcadf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:47.688786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:47.694648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6896b0-4280-4fcf-93da-3da73dd7f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:47.695342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6896b0-4280-4fcf-93da-3da73dd7f396 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:47.695623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6896b0-4280-4fcf-93da-3da73dd7f396 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:47.695907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6896b0-4280-4fcf-93da-3da73dd7f396 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:47.696756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6896b0-4280-4fcf-93da-3da73dd7f396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:47.697067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6896b0-4280-4fcf-93da-3da73dd7f396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:47.698577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6896b0-4280-4fcf-93da-3da73dd7f396 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:47.709860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 599/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:47.715653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:47.769405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:47.818931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69bbd0-faec-4980-ae62-6c8e273e1471 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:47.852469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491e462-509b-438d-adaa-cd001594fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:47.853130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491e462-509b-438d-adaa-cd001594fcf8 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:47.853412 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491e462-509b-438d-adaa-cd001594fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:47.853686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491e462-509b-438d-adaa-cd001594fcf8 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:47.854411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491e462-509b-438d-adaa-cd001594fcf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:47.855851 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491e462-509b-438d-adaa-cd001594fcf8 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:47.943634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 606/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 30 11:59:47 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 11:59:50.214251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9dfde-2e43-40ad-9666-d8def645dad2 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:50.214747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9dfde-2e43-40ad-9666-d8def645dad2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:50.214747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9dfde-2e43-40ad-9666-d8def645dad2 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:50.216334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 600/1206] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:50.221643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b00cd-d6a1-4bdf-a744-46cb8bffdf9e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:50.222145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b00cd-d6a1-4bdf-a744-46cb8bffdf9e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:50.222361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b00cd-d6a1-4bdf-a744-46cb8bffdf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:50.238895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9f0b00cd-d6a1-4bdf-a744-46cb8bffdf9e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:50.240078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9f0b00cd-d6a1-4bdf-a744-46cb8bffdf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:50.305052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 607/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:59:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 11:59:50.329637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9dfde-2e43-40ad-9666-d8def645dad2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:50.429485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9dfde-2e43-40ad-9666-d8def645dad2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:50.463077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d1425-6a39-470f-8005-c5cffd1b31c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:50.463929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d1425-6a39-470f-8005-c5cffd1b31c9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:50.464217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d1425-6a39-470f-8005-c5cffd1b31c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:50.464545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d1425-6a39-470f-8005-c5cffd1b31c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:50.474977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d1425-6a39-470f-8005-c5cffd1b31c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-cb5d1425-6a39-470f-8005-c5cffd1b31c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:59:50.482868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:50.483971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:59:50.485041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 601/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:59:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:50.490214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b00cd-d6a1-4bdf-a744-46cb8bffdf9e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:50.529902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:50.587544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b00cd-d6a1-4bdf-a744-46cb8bffdf9e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:50.620905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:50.621569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:50.621853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:50.622207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:50.624859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:50.624859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:50.624859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:50.632277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 608/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:50.638089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d1425-6a39-470f-8005-c5cffd1b31c9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:50.690089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:50.737631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d1425-6a39-470f-8005-c5cffd1b31c9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:50.772155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:50.772982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:50.773269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:50.773547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:50.783232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:50.784667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:59:50.802194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:50.805539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:50.806827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:59:50.806827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:59:50.806827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:50.806827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:59:50.806827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 602/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:50.809734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:50.904922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:50.907803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256837d3-8a81-4c8d-9b3e-f04c33d8334d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:50.940784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:50.941437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:50.941724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:50.942028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:50.942748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:50.943054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:50.944419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:50.955730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 609/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:50.962107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:51.061124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beefe54-876a-4b36-b906-e91f9174607b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:51.062737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:51.094815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:51.095652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:51.097848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:51.097848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:51.103800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:51.105254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:59:51.121046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:51.122243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:59:51.123508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 603/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:51.128230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:51.227845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da521d1f-108b-4933-9bf1-fef2158eda87 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:51.261618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:51.262435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:51.262728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:51.263010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:51.263846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:51.264160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:51.265639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:51.283218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 610/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 30 11:59:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:51.289695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:51.387014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa048a05-f67a-4619-b985-3242b54d4709 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:51.420035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d3c5d-4fe2-4072-b616-5f975aa44a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:51.420673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d3c5d-4fe2-4072-b616-5f975aa44a9f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:51.420953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d3c5d-4fe2-4072-b616-5f975aa44a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:51.421225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d3c5d-4fe2-4072-b616-5f975aa44a9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:51.451720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:51.490132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d3c5d-4fe2-4072-b616-5f975aa44a9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:51.491649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d3c5d-4fe2-4072-b616-5f975aa44a9f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:51.588242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 604/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:59:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 11:59:51.593913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:51.612684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:51.692034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc228878-ff71-464c-8a6d-2d47553e0fb0 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:51.726526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:51.727312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:51.727603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:51.727885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:51.739588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:51.742845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:59:51.759598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:51.760752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:51.762043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:59:51.762043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:59:51.762043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:51.762043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:59:51.762043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 611/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:51.766430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d3c5d-4fe2-4072-b616-5f975aa44a9f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:51.825096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:51.860662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d3c5d-4fe2-4072-b616-5f975aa44a9f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:51.895724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:51.896385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:51.896670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:51.896950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:51.897670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:51.898001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:51.899382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:51.910231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 605/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:51.915737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:51.988886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:52.018850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa666cb-9a19-4b54-9271-fa3ab602387c None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:52.051709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:52.061924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:52.061924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:52.061924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:52.061924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:52.061924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:59:52.076221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:52.077261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:59:52.078259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 612/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:59:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:52.083301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:52.181901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233073f-6bb7-4b72-848b-51cb766e4c3a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:52.203390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:52.214647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d55ebe-a2f6-480a-b58f-3c4af5e1a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:52.215306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55ebe-a2f6-480a-b58f-3c4af5e1a858 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:52.215595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55ebe-a2f6-480a-b58f-3c4af5e1a858 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:52.215876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55ebe-a2f6-480a-b58f-3c4af5e1a858 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:52.216764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d55ebe-a2f6-480a-b58f-3c4af5e1a858 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:52.217079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d55ebe-a2f6-480a-b58f-3c4af5e1a858 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:52.218634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d55ebe-a2f6-480a-b58f-3c4af5e1a858 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:52.230695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 606/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:52.236748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:52.335633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28446e-47b2-42f8-9e4b-53bcb6c0dfac None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:52.362937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:52.369085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec033482-0bc7-44c4-b23a-0ac99136cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:52.369726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033482-0bc7-44c4-b23a-0ac99136cea5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:52.370034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033482-0bc7-44c4-b23a-0ac99136cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:52.370313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033482-0bc7-44c4-b23a-0ac99136cea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:52.371134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec033482-0bc7-44c4-b23a-0ac99136cea5 None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=49f847d54d334342b54d6f3189166ef3) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:52.371458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec033482-0bc7-44c4-b23a-0ac99136cea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:52.372868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec033482-0bc7-44c4-b23a-0ac99136cea5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:52.378189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 613/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 11:59:52 2022] GET /identity/v3/role_assignments?user.id=49f847d54d334342b54d6f3189166ef3&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:54.590872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4648-0105-4b96-928b-017f563451ad None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:54.591423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4648-0105-4b96-928b-017f563451ad None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:54.591423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4648-0105-4b96-928b-017f563451ad None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:54.592772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 607/1220] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:54.598134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cd7a-9be9-4d7d-8f74-f74f34a8626e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:54.601153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cd7a-9be9-4d7d-8f74-f74f34a8626e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:54.601153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637cd7a-9be9-4d7d-8f74-f74f34a8626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:54.615303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7637cd7a-9be9-4d7d-8f74-f74f34a8626e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:54.619974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7637cd7a-9be9-4d7d-8f74-f74f34a8626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:54.682743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 614/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:59:54.706474 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d4648-0105-4b96-928b-017f563451ad None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:54.806736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d4648-0105-4b96-928b-017f563451ad None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:54.840560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1256-752e-4c63-9323-9e144d7a1ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:54.841397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1256-752e-4c63-9323-9e144d7a1ece None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:54.841632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1256-752e-4c63-9323-9e144d7a1ece None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:54.841906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1256-752e-4c63-9323-9e144d7a1ece None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:54.851824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed1256-752e-4c63-9323-9e144d7a1ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-19ed1256-752e-4c63-9323-9e144d7a1ece None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:59:54.859558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:54.860668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:59:54.861707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 608/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:59:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:59:54.867325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637cd7a-9be9-4d7d-8f74-f74f34a8626e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:54.964671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637cd7a-9be9-4d7d-8f74-f74f34a8626e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:54.987018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:54.998141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:54.998815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:54.999107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:54.999386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:55.000129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] RBAC: Adding query filter params (name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:55.000438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:55.001830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:55.011358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 615/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:59:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:55.016120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1256-752e-4c63-9323-9e144d7a1ece None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:55.059560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:55.114610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1256-752e-4c63-9323-9e144d7a1ece None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:55.148904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:55.149731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:55.150042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:55.150320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:55.160663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:55.162173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:59:55.179953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:55.181067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:55.182388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:59:55.182388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:59:55.182388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:55.182388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:59:55.182388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 609/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:55.187115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:55.283486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6217a-f690-4fae-9e59-ddd6344cd88a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:55.317110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:55.317763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:55.318079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:55.318359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:55.319072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:55.319408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:55.320794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:55.332860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 616/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:55.338562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:55.431592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:55.438340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44701-7748-4879-921d-592e4b5fb6a5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:55.470231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:55.471025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:55.471309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:55.471593 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:55.480010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:55.481632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:59:55.495752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:55.502844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:59:55.504053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 610/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:55.504784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:55.549314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:55.599727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee762-363b-4a8f-b837-1301e33b2c66 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:55.632432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:55.633091 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:55.633370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:55.633651 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:55.634512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:55.634823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:55.636261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:55.653097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 617/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 30 11:59:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:55.658687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:55.758108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb04ff-7b34-440e-827a-053b5ee5c501 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:55.792073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:55.792863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:55.793181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:55.793464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:55.803797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:55.805256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:59:55.822479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:55.824454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:55.825471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:59:55.825471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:59:55.825471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:55.825471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:59:55.825471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 611/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:55.829564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:55.927815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840ed1e-7a88-43ed-ab41-fd2e70ef1b0d None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:55.930256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:55.961999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:55.962654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:55.962944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:55.963225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:55.963944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:55.964251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:55.965673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:55.976729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 618/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:55.982430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:55.991686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:56.082577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ebf5-0336-4594-b058-f165fe064709 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:56.117303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:56.118126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:56.118417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:56.118696 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:56.125558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:56.127050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 11:59:56.143063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:56.144104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 11:59:56.145117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 612/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 11:59:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:56.150935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:56.252639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e72a9-32e5-49ce-81de-b56907f93eed None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:56.286119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfad4e-d46c-4886-b8a4-de91cc45233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:56.286784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfad4e-d46c-4886-b8a4-de91cc45233c None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:56.287074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfad4e-d46c-4886-b8a4-de91cc45233c None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:56.287357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfad4e-d46c-4886-b8a4-de91cc45233c None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:56.288172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfad4e-d46c-4886-b8a4-de91cc45233c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:56.288486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfad4e-d46c-4886-b8a4-de91cc45233c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:56.289975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfad4e-d46c-4886-b8a4-de91cc45233c None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:56.302103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 619/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 11:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:56.308636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:56.371849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:56.405264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc93001-00a7-4925-a89b-3dbd3c3951e5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:56.438244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d220c4-68f5-4519-b4fc-25bcaab4647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:56.439123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d220c4-68f5-4519-b4fc-25bcaab4647b None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:56.439401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d220c4-68f5-4519-b4fc-25bcaab4647b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:56.439679 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d220c4-68f5-4519-b4fc-25bcaab4647b None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/49f847d54d334342b54d6f3189166ef3/roles/aac7e705dfc84393a31372f43cedd793` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:56.454479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d220c4-68f5-4519-b4fc-25bcaab4647b None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=49f847d54d334342b54d6f3189166ef3, role_id=aac7e705dfc84393a31372f43cedd793)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:56.455971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d220c4-68f5-4519-b4fc-25bcaab4647b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:56.519750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 613/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 11:59:56 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/49f847d54d334342b54d6f3189166ef3/roles/aac7e705dfc84393a31372f43cedd793 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 11:59:58.720634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6012d-8ccb-442d-bab8-fa0b2ce618a7 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:58.721191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6012d-8ccb-442d-bab8-fa0b2ce618a7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:58.721191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6012d-8ccb-442d-bab8-fa0b2ce618a7 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:58.722650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 620/1233] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 11:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 11:59:58.728444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b21d2e-227e-4f75-b078-3ea33ad3311d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:58.728838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b21d2e-227e-4f75-b078-3ea33ad3311d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:58.729013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b21d2e-227e-4f75-b078-3ea33ad3311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:58.745399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e0b21d2e-227e-4f75-b078-3ea33ad3311d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 11:59:58.746632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e0b21d2e-227e-4f75-b078-3ea33ad3311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 11:59:58.812433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 614/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 11:59:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 11:59:58.836881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6012d-8ccb-442d-bab8-fa0b2ce618a7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:58.862128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:58.939385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6012d-8ccb-442d-bab8-fa0b2ce618a7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:58.973242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadc20-8c3b-4853-b9d2-500a14a2f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:58.974002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadc20-8c3b-4853-b9d2-500a14a2f427 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:58.974294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadc20-8c3b-4853-b9d2-500a14a2f427 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:58.974574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadc20-8c3b-4853-b9d2-500a14a2f427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:58.984923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebadc20-8c3b-4853-b9d2-500a14a2f427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-1ebadc20-8c3b-4853-b9d2-500a14a2f427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 11:59:58.993298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:58.994456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:59:58.995484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 621/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 30 11:59:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:59.000721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b21d2e-227e-4f75-b078-3ea33ad3311d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:59.047548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:59.099633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b21d2e-227e-4f75-b078-3ea33ad3311d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:59.133076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:59.133744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:59.134064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:59.134351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:59.135097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:59.135407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:59.136949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:59.145907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 615/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 30 11:59:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:59.151613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadc20-8c3b-4853-b9d2-500a14a2f427 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:59.236901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:59.252467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadc20-8c3b-4853-b9d2-500a14a2f427 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:59.284674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:59.285828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:59.286475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:59.287172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:59.298539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:59.300051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 11:59:59.317525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:59.318683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:59.319772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 11:59:59.319772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 11:59:59.319772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 11:59:59.319772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:59:59.319772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 622/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 11:59:59.324827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:59.425412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1552ca-6558-42ee-8f37-9e31510e1c9c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:59.434498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:59.458550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:59.459210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:59.459494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:59.460259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:59.460972 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:59.461274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:59.462712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:59.473517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 616/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 11:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:59.479820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:59.580433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed220-607a-4bdf-9f3c-5551a77e7fa9 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:59.614205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:59.615002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:59.615289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:59.615567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:59.618311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:59.623110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:59.624542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 11:59:59.639073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 11:59:59.670269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 11:59:59.671428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 623/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 11:59:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 11:59:59.672096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:59.745499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6cd2a-4f42-4a7a-8879-9fac82fa0bcf None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:59.779574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:59.780237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:59.780521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:59.780796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 11:59:59.781624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 11:59:59.781933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 11:59:59.783396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 11:59:59.800714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 617/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 30 11:59:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 11:59:59.807176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 11:59:59.906658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3eba-f753-418a-8973-b024d7633511 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 11:59:59.939801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45875bc3-99b1-45b4-a57e-bc97bb646c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 11:59:59.940440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45875bc3-99b1-45b4-a57e-bc97bb646c25 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 11:59:59.940731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45875bc3-99b1-45b4-a57e-bc97bb646c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 11:59:59.941011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45875bc3-99b1-45b4-a57e-bc97bb646c25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.001573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:00.008521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45875bc3-99b1-45b4-a57e-bc97bb646c25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:00.010042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45875bc3-99b1-45b4-a57e-bc97bb646c25 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:00.104527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 624/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 11:59:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 12:00:00.110265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:00.138752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:00.210427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f04ad-e14c-4539-86f5-3112b65126ba None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:00.243225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:00.244010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:00.244293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:00.244567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.254366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:00.255802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 12:00:00.273336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:00.274436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:00.275557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 12:00:00.275557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 12:00:00.275557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:00.275557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:00.275557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 618/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:00.280451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45875bc3-99b1-45b4-a57e-bc97bb646c25 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:00.371860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:00.377570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45875bc3-99b1-45b4-a57e-bc97bb646c25 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:00.410025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:00.410780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:00.411069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:00.411351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.412220 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:00.412531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:00.414478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:00.425666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 625/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 12:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:00.431828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:00.510825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:00.531908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1756a6-bbd5-49a7-8615-5767e7bd2573 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:00.566936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:00.567834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:00.568123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:00.568402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.575155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:00.576705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 12:00:00.590582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:00.591635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:00.592745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 619/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 12:00:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:00.597700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:00.697843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608b30a-2259-4dcb-b8f2-15ec898a6c1b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:00.730894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801764f-ff1c-46ce-9048-cb2114b52acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:00.731675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801764f-ff1c-46ce-9048-cb2114b52acf None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:00.732111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801764f-ff1c-46ce-9048-cb2114b52acf None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:00.732494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801764f-ff1c-46ce-9048-cb2114b52acf None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.733381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801764f-ff1c-46ce-9048-cb2114b52acf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:00.733689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801764f-ff1c-46ce-9048-cb2114b52acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:00.735417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801764f-ff1c-46ce-9048-cb2114b52acf None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:00.749938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 626/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 12:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:00.755788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:00.854656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b31e8-ff98-4e49-a18a-7a8a2056aad5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:00.888263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1eb5-ee01-4886-bd86-022282154ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:00.888968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1eb5-ee01-4886-bd86-022282154ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:00.889312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1eb5-ee01-4886-bd86-022282154ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:00.889589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1eb5-ee01-4886-bd86-022282154ec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:00.890457 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1eb5-ee01-4886-bd86-022282154ec1 None admin] RBAC: Adding query filter params (role.id=aac7e705dfc84393a31372f43cedd793, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=49f847d54d334342b54d6f3189166ef3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:00.890772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1eb5-ee01-4886-bd86-022282154ec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:00.892211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1eb5-ee01-4886-bd86-022282154ec1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:00.898692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 620/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 12:00:00 2022] GET /identity/v3/role_assignments?user.id=49f847d54d334342b54d6f3189166ef3&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=aac7e705dfc84393a31372f43cedd793 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:03.135142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562eb4-ea1e-42a8-9452-8a0ef460ddca None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.135681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562eb4-ea1e-42a8-9452-8a0ef460ddca None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.135681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562eb4-ea1e-42a8-9452-8a0ef460ddca None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.137049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 627/1247] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:03.142395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e52cb-03f1-4da2-8b4b-0e32cea6e7ec None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.142816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e52cb-03f1-4da2-8b4b-0e32cea6e7ec None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.142955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e52cb-03f1-4da2-8b4b-0e32cea6e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.148415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:03.160351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d23e52cb-03f1-4da2-8b4b-0e32cea6e7ec None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:03.161529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d23e52cb-03f1-4da2-8b4b-0e32cea6e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:03.227174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 621/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:00:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 12:00:03.250759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c562eb4-ea1e-42a8-9452-8a0ef460ddca None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:03.269235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:03.349742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c562eb4-ea1e-42a8-9452-8a0ef460ddca None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:03.386440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7feda-5044-4363-8b27-8b2886a37bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:03.387164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7feda-5044-4363-8b27-8b2886a37bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.387447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7feda-5044-4363-8b27-8b2886a37bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.387718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7feda-5044-4363-8b27-8b2886a37bd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.398103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7feda-5044-4363-8b27-8b2886a37bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-efd7feda-5044-4363-8b27-8b2886a37bd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 12:00:03.405663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:03.408879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:03.409760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 628/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 12:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:03.412921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e52cb-03f1-4da2-8b4b-0e32cea6e7ec None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:03.509899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e52cb-03f1-4da2-8b4b-0e32cea6e7ec None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:03.539491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:03.544406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:03.545074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.545363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.545641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.546570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:03.546886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:03.548265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:03.556275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 622/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 12:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:03.562482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7feda-5044-4363-8b27-8b2886a37bd4 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:03.639840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:03.662589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7feda-5044-4363-8b27-8b2886a37bd4 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:03.696491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:03.697270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.697558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.697838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.708068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:03.709506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 12:00:03.726779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:03.727662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:03.728598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 12:00:03.728598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 12:00:03.728598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:03.728598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:03.728598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 629/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:03.733898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:03.833518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd57ee9-f9b6-4734-bf75-43da375068d3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:03.866646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:03.867302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:03.867587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:03.867857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:03.868566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:03.868868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:03.870256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:03.882216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 623/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 12:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:03.888010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:03.987913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01b65-7a99-4efb-bffa-539fe8727559 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:04.014212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:04.021670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:04.022665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:04.022953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:04.023229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:04.030479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:04.031919 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 12:00:04.045911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:04.047071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:04.048066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 630/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:04.052975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:04.108585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:04.151470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735249-37d9-4fda-bde5-8b8ddc1a5779 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:04.184996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:04.185918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:04.186236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:04.186516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:04.187392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:04.187744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:04.189181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:04.206630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 624/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 30 12:00:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:04.212332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:04.313205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d41de-2b9f-45b4-a376-3c4796d39df5 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:04.345298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41ae7c-c0b4-4ba3-97c9-738a4c57c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:04.345933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ae7c-c0b4-4ba3-97c9-738a4c57c281 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:04.346241 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ae7c-c0b4-4ba3-97c9-738a4c57c281 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:04.346514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ae7c-c0b4-4ba3-97c9-738a4c57c281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:04.399622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:04.411448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41ae7c-c0b4-4ba3-97c9-738a4c57c281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:04.413405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41ae7c-c0b4-4ba3-97c9-738a4c57c281 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:04.507175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 631/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 12:00:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 12:00:04.513025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:04.611651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc039-8552-4130-a1da-fb1e3b85df55 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:04.624383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:04.644208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:04.645021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:04.645301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:04.645576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:04.655667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:04.657153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 12:00:04.674961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:04.676075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:04.677201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 12:00:04.677201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 12:00:04.677201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:04.677201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:04.677201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 625/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:04.682041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41ae7c-c0b4-4ba3-97c9-738a4c57c281 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:04.768403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:04.782731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41ae7c-c0b4-4ba3-97c9-738a4c57c281 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:04.816282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:04.816945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:04.817237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:04.817520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:04.818278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:04.818589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:04.819962 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:04.831417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 632/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 12:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:04.838715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:04.939028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fad448-0a07-4715-87be-3638ca3d71b7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:04.973351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:04.974159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:04.974449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:04.974729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:04.981566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:04.983059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 12:00:04.996754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:04.997799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:04.998810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 626/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 12:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:05.004037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:05.102866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad928b5-79cb-44d3-9b75-84ce15e13bea None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:05.136447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e14d60-dbea-4b80-ac19-2421f99bdc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:05.137101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e14d60-dbea-4b80-ac19-2421f99bdc7e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:05.137391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e14d60-dbea-4b80-ac19-2421f99bdc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:05.137672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e14d60-dbea-4b80-ac19-2421f99bdc7e None admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:05.138483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e14d60-dbea-4b80-ac19-2421f99bdc7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:05.138797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e14d60-dbea-4b80-ac19-2421f99bdc7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:05.140226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e14d60-dbea-4b80-ac19-2421f99bdc7e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:05.152614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 633/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 12:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:05.158759 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:05.184766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:05.260650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c4f0-2a75-4a06-837f-4da4735469dd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:05.293164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76020971-961b-41fe-8a55-ade586c97ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:05.293806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020971-961b-41fe-8a55-ade586c97ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:05.294122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020971-961b-41fe-8a55-ade586c97ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:05.294397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76020971-961b-41fe-8a55-ade586c97ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:05.295213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76020971-961b-41fe-8a55-ade586c97ce0 None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=49f847d54d334342b54d6f3189166ef3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:05.295519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76020971-961b-41fe-8a55-ade586c97ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:05.296978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76020971-961b-41fe-8a55-ade586c97ce0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:05.302324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 627/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 12:00:05 2022] GET /identity/v3/role_assignments?user.id=49f847d54d334342b54d6f3189166ef3&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=f3f138e4021a4b7dada39089dd427266 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:07.500253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67606dd-8635-4ec7-9777-38ec7803fba7 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:07.500800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67606dd-8635-4ec7-9777-38ec7803fba7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:07.500800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67606dd-8635-4ec7-9777-38ec7803fba7 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:07.502293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 634/1261] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:07.507357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8fe37-85d6-4268-bfbb-7c46e95cdcf0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:07.507808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8fe37-85d6-4268-bfbb-7c46e95cdcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:07.507902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8fe37-85d6-4268-bfbb-7c46e95cdcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:07.524849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-47b8fe37-85d6-4268-bfbb-7c46e95cdcf0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:07.526007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-47b8fe37-85d6-4268-bfbb-7c46e95cdcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:07.592153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 628/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:00:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 12:00:07.615071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67606dd-8635-4ec7-9777-38ec7803fba7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:07.625774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:07.718445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67606dd-8635-4ec7-9777-38ec7803fba7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:07.752094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c641-d3d2-489a-b972-d3b6b5810e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:07.752831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c641-d3d2-489a-b972-d3b6b5810e11 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:07.753145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c641-d3d2-489a-b972-d3b6b5810e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:07.753430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c641-d3d2-489a-b972-d3b6b5810e11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:07.763513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106c641-d3d2-489a-b972-d3b6b5810e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-b106c641-d3d2-489a-b972-d3b6b5810e11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 12:00:07.771242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:07.772830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:07.773927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 635/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 12:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 30 12:00:07.778996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8fe37-85d6-4268-bfbb-7c46e95cdcf0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:07.797749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:07.875637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8fe37-85d6-4268-bfbb-7c46e95cdcf0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:07.908595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:07.909250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:07.909552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:07.911993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:07.911993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:07.911993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:07.912313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:07.920077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 629/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 12:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:07.926010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c641-d3d2-489a-b972-d3b6b5810e11 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:07.991947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:08.025537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c641-d3d2-489a-b972-d3b6b5810e11 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:08.057342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:08.058154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.058449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.058770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.070921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:08.072387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 12:00:08.090356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:08.091478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:08.092599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 12:00:08.092599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 12:00:08.092599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:08.092599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:08.092599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 636/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:08.097330 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:08.179410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:08.198980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9daec0-52be-4817-a623-08e8f63f1188 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:08.231859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:08.232517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.232806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.233097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.233879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:08.234420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:08.236154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:08.250168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 630/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 12:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:08.255861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:08.355411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa1eba-1afb-4e1b-907f-119be2a815dc None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:08.375515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:08.389602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:08.390430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.390722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.391002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.398360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:08.399842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 12:00:08.414150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:08.415252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:08.416201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 637/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:08.421151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:08.520429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d4ab-e380-47e5-bdcb-3d92ace5acd2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:08.553078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:08.554284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.554570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.554843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.555670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:08.555979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:08.557484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:08.566306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:08.575092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 631/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 30 12:00:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:08.580862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:08.679301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefd035-7d84-4e61-ae34-0ba1a1f0119e None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:08.711777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:08.712555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.712843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.713194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.723386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:08.724821 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 12:00:08.742788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:08.743849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:08.744930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 12:00:08.744930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 12:00:08.744930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:08.744930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:08.744930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 638/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:08.749734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:08.847764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8753e1-17ab-4d7e-b16d-922ba3b3f0ba None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:08.882660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:08.883320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:08.883602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:08.883875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:08.884589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:08.884896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:08.886303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:08.897113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 632/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 12:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:08.902829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:08.934955 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:09.002543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215346-6d31-4df2-8f0d-5228b7f898ed None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:09.035186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:09.035970 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:09.036258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:09.036537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:09.043665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:09.045149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 12:00:09.059883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:09.061298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:09.064886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 639/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 12:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:09.067390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:09.126835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:09.168466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4865740-0470-4d1c-85dc-0de1b4926ce7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:09.202869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009e9af-b7ce-4881-8af6-b625a0d01bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:09.203464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e9af-b7ce-4881-8af6-b625a0d01bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:09.203783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e9af-b7ce-4881-8af6-b625a0d01bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:09.204098 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009e9af-b7ce-4881-8af6-b625a0d01bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:09.204940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e9af-b7ce-4881-8af6-b625a0d01bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:09.205246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e9af-b7ce-4881-8af6-b625a0d01bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:09.206723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009e9af-b7ce-4881-8af6-b625a0d01bb3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:09.218650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 633/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 12:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:09.224544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:09.313456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:09.322260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9e5bd-49d2-46b7-ba51-78502b88b05f None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:09.355232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3c2d-2574-405a-9141-6b8607b5128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:09.356106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3c2d-2574-405a-9141-6b8607b5128e None admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:09.356392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3c2d-2574-405a-9141-6b8607b5128e None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:09.356671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3c2d-2574-405a-9141-6b8607b5128e None admin] PATH_INFO: `/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/49f847d54d334342b54d6f3189166ef3/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:09.358610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb3c2d-2574-405a-9141-6b8607b5128e None admin] RBAC: Authorizing `identity:create_grant(project_id=80d3f55587084ccbaa3331cc71ea1ffb, user_id=49f847d54d334342b54d6f3189166ef3, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:09.360122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb3c2d-2574-405a-9141-6b8607b5128e None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:09.439915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 640/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 30 12:00:09 2022] PUT /identity/v3/projects/80d3f55587084ccbaa3331cc71ea1ffb/users/49f847d54d334342b54d6f3189166ef3/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:00:11.633523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27b29-b910-43b0-b1f1-d8c70095d3f5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:11.634157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27b29-b910-43b0-b1f1-d8c70095d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:11.634157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27b29-b910-43b0-b1f1-d8c70095d3f5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:11.635661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 634/1274] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:11.640782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c52515-2699-42f0-8e2d-469be21b057e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:11.641233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c52515-2699-42f0-8e2d-469be21b057e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:11.641342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c52515-2699-42f0-8e2d-469be21b057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:11.658725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f6c52515-2699-42f0-8e2d-469be21b057e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:11.659929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f6c52515-2699-42f0-8e2d-469be21b057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:11.727366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 641/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:00:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 30 12:00:11.751426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a27b29-b910-43b0-b1f1-d8c70095d3f5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:11.849077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a27b29-b910-43b0-b1f1-d8c70095d3f5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:11.865930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:11.882264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977abb4c-c049-48c3-8077-4932cee7f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:11.883050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977abb4c-c049-48c3-8077-4932cee7f7bc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:11.883335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977abb4c-c049-48c3-8077-4932cee7f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:11.883657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977abb4c-c049-48c3-8077-4932cee7f7bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:11.893203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977abb4c-c049-48c3-8077-4932cee7f7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-977abb4c-c049-48c3-8077-4932cee7f7bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 30 12:00:11.901392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:11.902519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:11.903723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 635/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 30 12:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:11.908556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c52515-2699-42f0-8e2d-469be21b057e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:11.987198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:12.004612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c52515-2699-42f0-8e2d-469be21b057e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:12.036482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:12.037136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:12.037418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:12.037693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:12.038478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:12.038785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:12.040161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:12.048617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 642/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 30 12:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:12.054697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977abb4c-c049-48c3-8077-4932cee7f7bc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:12.154006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977abb4c-c049-48c3-8077-4932cee7f7bc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:12.189040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:12.189884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:12.190206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:12.190485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:12.202327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:12.203843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 12:00:12.221300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:12.222426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:12.223455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 12:00:12.223455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 12:00:12.223455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:12.223455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:12.223455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 636/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:12.228909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:12.330285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bcdc6-4967-4fcb-9fd6-2f37537343bd None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:12.365189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:12.365864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:12.366817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:12.367102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:12.367824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:12.368129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:12.369547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:12.381465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 643/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 12:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:12.387433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:12.417989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:12.485683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f079-0028-4d94-84c9-7e601771d1cd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:12.519586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:12.520377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:12.520660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:12.520997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:12.529253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:12.530728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 30 12:00:12.545217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:12.546403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:12.547707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 637/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:12.552222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:12.556641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:12.649602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165a466-a867-4a3c-83cb-7793e36c6c9a None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:12.683171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:12.683771 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:12.684064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:12.684345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:12.685170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:12.685481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:12.687213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:12.703640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 644/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 30 12:00:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:12.709412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:12.801246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:12.810870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1f8c6-b2ba-4158-9d7a-b29ba8520eb9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:12.843934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e36577-a052-4f17-a79a-7630b0160c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:12.844574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e36577-a052-4f17-a79a-7630b0160c9f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:12.844855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e36577-a052-4f17-a79a-7630b0160c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:12.845129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e36577-a052-4f17-a79a-7630b0160c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:12.909447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e36577-a052-4f17-a79a-7630b0160c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:12.910943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e36577-a052-4f17-a79a-7630b0160c9f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:12.997717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:13.007892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 638/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 30 12:00:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 30 12:00:13.013855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:13.076815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:13.114230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129f98e-5569-41a8-83da-092a233d36b7 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:13.148401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:13.149418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:13.149905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:13.150247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:13.160505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:13.161977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 30 12:00:13.179101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:13.180190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:13.181628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 30 12:00:13.181628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 30 12:00:13.181628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 30 12:00:13.181628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:13.181628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 645/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:13.186354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e36577-a052-4f17-a79a-7630b0160c9f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:13.285537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e36577-a052-4f17-a79a-7630b0160c9f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:13.321025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:13.321683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:13.322004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:13.322280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:13.322999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:13.323326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:13.324675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:13.336213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 639/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 30 12:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:13.342087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:13.436309 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967e8d-724e-47fc-ae31-a4f83e8071b2 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:13.450001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:13.469635 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:13.477190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:13.477190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:13.477190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:13.477622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:13.479106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(project_id) May 30 12:00:13.493553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application with Lock( May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:13.494713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: ERROR keystone.server.flask.application May 30 12:00:13.495917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 646/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 30 12:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:13.500689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:13.550059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:13.599822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25023e-0448-47af-b6e1-47ab3c132c98 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:13.633793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33157bd5-c038-4c07-86f3-5592693904ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:13.634474 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157bd5-c038-4c07-86f3-5592693904ac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:13.634762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157bd5-c038-4c07-86f3-5592693904ac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:13.635041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157bd5-c038-4c07-86f3-5592693904ac None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:13.635825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33157bd5-c038-4c07-86f3-5592693904ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:13.636133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33157bd5-c038-4c07-86f3-5592693904ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:13.637578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33157bd5-c038-4c07-86f3-5592693904ac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:13.649374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 640/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 30 12:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:13.655423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:13.754931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfeff0-d143-4f67-a345-007dc81b5ec1 None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:13.788426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf9c10-8989-435d-93b9-4e9052d4b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:13.789075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9c10-8989-435d-93b9-4e9052d4b825 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:13.789363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9c10-8989-435d-93b9-4e9052d4b825 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:13.789643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf9c10-8989-435d-93b9-4e9052d4b825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:13.790499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf9c10-8989-435d-93b9-4e9052d4b825 None admin] RBAC: Adding query filter params (role.id=f3f138e4021a4b7dada39089dd427266, scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb, user.id=49f847d54d334342b54d6f3189166ef3) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:13.790815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf9c10-8989-435d-93b9-4e9052d4b825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:13.792248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf9c10-8989-435d-93b9-4e9052d4b825 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:13.798084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 647/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 30 12:00:13 2022] GET /identity/v3/role_assignments?user.id=49f847d54d334342b54d6f3189166ef3&scope.project.id=80d3f55587084ccbaa3331cc71ea1ffb&role.id=f3f138e4021a4b7dada39089dd427266 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:16.070947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab46f-a4cb-4393-b4cd-1fd502edbd4f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:16.071464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab46f-a4cb-4393-b4cd-1fd502edbd4f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:16.071464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab46f-a4cb-4393-b4cd-1fd502edbd4f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:16.072843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 641/1288] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:16.078038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133cb4-4be0-48d7-8361-2ff0eef11cd8 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:16.078437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133cb4-4be0-48d7-8361-2ff0eef11cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:16.078599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133cb4-4be0-48d7-8361-2ff0eef11cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:16.094847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4c133cb4-4be0-48d7-8361-2ff0eef11cd8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:16.096013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4c133cb4-4be0-48d7-8361-2ff0eef11cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:16.125284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:16.160035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 648/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:00:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 12:00:16.183479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab46f-a4cb-4393-b4cd-1fd502edbd4f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:16.283452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab46f-a4cb-4393-b4cd-1fd502edbd4f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:16.295039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:16.317908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:16.318734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:16.319020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:16.319295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:16.319938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:16.321370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:16.332857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:16.334164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:16.335740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 642/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 12:00:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:16.340058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133cb4-4be0-48d7-8361-2ff0eef11cd8 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:16.435360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133cb4-4be0-48d7-8361-2ff0eef11cd8 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:16.468279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98d2f8-bdf6-451b-a3ef-331c77ee1dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:16.468929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98d2f8-bdf6-451b-a3ef-331c77ee1dcb None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:16.469212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98d2f8-bdf6-451b-a3ef-331c77ee1dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:16.469489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98d2f8-bdf6-451b-a3ef-331c77ee1dcb None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:16.470211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98d2f8-bdf6-451b-a3ef-331c77ee1dcb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:16.470516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98d2f8-bdf6-451b-a3ef-331c77ee1dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:16.471879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98d2f8-bdf6-451b-a3ef-331c77ee1dcb None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:16.477252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 649/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 30 12:00:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:16.482968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:16.578927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35ce7-b81a-4162-bf59-bba81aef825e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:16.612143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f535e7-dc46-45a2-999b-27e8feb9620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:16.612798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f535e7-dc46-45a2-999b-27e8feb9620e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:16.613086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f535e7-dc46-45a2-999b-27e8feb9620e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:16.613367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f535e7-dc46-45a2-999b-27e8feb9620e None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:16.614096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f535e7-dc46-45a2-999b-27e8feb9620e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:16.614407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f535e7-dc46-45a2-999b-27e8feb9620e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:16.615780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f535e7-dc46-45a2-999b-27e8feb9620e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:16.620086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 643/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 30 12:00:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:18.825229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeb921-e313-4d50-9b36-158906068cd2 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:18.825747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeb921-e313-4d50-9b36-158906068cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:18.825858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eeb921-e313-4d50-9b36-158906068cd2 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:18.827298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 650/1293] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:18.832377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6ced-8fa8-40ca-98f5-f93a92ff65bb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:18.832754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6ced-8fa8-40ca-98f5-f93a92ff65bb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:18.832947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6ced-8fa8-40ca-98f5-f93a92ff65bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:18.849280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8bbd6ced-8fa8-40ca-98f5-f93a92ff65bb None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:18.850535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8bbd6ced-8fa8-40ca-98f5-f93a92ff65bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:18.879987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:18.916280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 644/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:00:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 12:00:18.939399 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eeb921-e313-4d50-9b36-158906068cd2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:18.970302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:19.037719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eeb921-e313-4d50-9b36-158906068cd2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:19.072308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a9d3-6887-4fc1-b57a-b13ba9ffe156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:19.072972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a9d3-6887-4fc1-b57a-b13ba9ffe156 None admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:19.073260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a9d3-6887-4fc1-b57a-b13ba9ffe156 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:19.073534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a9d3-6887-4fc1-b57a-b13ba9ffe156 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:19.074307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a9d3-6887-4fc1-b57a-b13ba9ffe156 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:19.076056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a9d3-6887-4fc1-b57a-b13ba9ffe156 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:19.189747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 651/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 30 12:00:18 2022] POST /identity/v3/services => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:00:21.399381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b46b-e2ef-4e85-a64d-f71bd9e58f2b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:21.399944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b46b-e2ef-4e85-a64d-f71bd9e58f2b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:21.399944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b46b-e2ef-4e85-a64d-f71bd9e58f2b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:21.401308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 645/1296] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:21.406420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72457-4c45-4fec-99ed-b666b948ad99 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:21.406803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72457-4c45-4fec-99ed-b666b948ad99 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:21.406985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72457-4c45-4fec-99ed-b666b948ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:21.422789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-80c72457-4c45-4fec-99ed-b666b948ad99 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:21.423965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-80c72457-4c45-4fec-99ed-b666b948ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:21.495138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 652/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:00:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 12:00:21.517954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b46b-e2ef-4e85-a64d-f71bd9e58f2b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:21.616116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07b46b-e2ef-4e85-a64d-f71bd9e58f2b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:21.649906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:21.650671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:21.651006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:21.651285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:21.651936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:21.653310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:21.665180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:21.667331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:21.668364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 646/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 12:00:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:21.672678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c72457-4c45-4fec-99ed-b666b948ad99 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:21.691084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:21.770528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c72457-4c45-4fec-99ed-b666b948ad99 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:21.804234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:21.804951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:21.805240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:21.805515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:21.806252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:21.806560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:21.807946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:21.813300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 653/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 30 12:00:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:21.820979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:21.850869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:21.916902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39502af-8f4f-4139-a309-e368a727d786 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:21.951870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2920f1-087a-400c-99dc-7266d98ca8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:21.952523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2920f1-087a-400c-99dc-7266d98ca8fb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:21.952863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2920f1-087a-400c-99dc-7266d98ca8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:21.953191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2920f1-087a-400c-99dc-7266d98ca8fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:21.954004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2920f1-087a-400c-99dc-7266d98ca8fb None admin] RBAC: Adding query filter params (interface=public, service_id=9e597c51a18c4625a43b05ef79ebf53b, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:21.954325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2920f1-087a-400c-99dc-7266d98ca8fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:21.955701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2920f1-087a-400c-99dc-7266d98ca8fb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:21.960676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 647/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 30 12:00:21 2022] GET /identity/v3/endpoints?service_id=9e597c51a18c4625a43b05ef79ebf53b&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:00:21.966218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:22.046065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:22.064093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5cc8-07f1-4aee-b387-616e15e7ec5b None admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:22.096812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505f7d5-5ff8-49d1-b766-91030bdc84ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:22.097466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f7d5-5ff8-49d1-b766-91030bdc84ce None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:22.097755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f7d5-5ff8-49d1-b766-91030bdc84ce None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:22.098062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505f7d5-5ff8-49d1-b766-91030bdc84ce None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:22.098738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505f7d5-5ff8-49d1-b766-91030bdc84ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:22.100156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505f7d5-5ff8-49d1-b766-91030bdc84ce None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:22.107396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 654/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 30 12:00:21 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:00:24.327666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048eb8c-e8e0-480a-8d84-d8f03a76f076 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:24.328225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048eb8c-e8e0-480a-8d84-d8f03a76f076 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:24.328225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048eb8c-e8e0-480a-8d84-d8f03a76f076 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:24.329606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 648/1302] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:00:24.335642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cac429-1608-4397-9d43-58b7c91768f2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:24.336033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cac429-1608-4397-9d43-58b7c91768f2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:24.336207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cac429-1608-4397-9d43-58b7c91768f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:24.352949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-31cac429-1608-4397-9d43-58b7c91768f2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:00:24.354180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-31cac429-1608-4397-9d43-58b7c91768f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:00:24.419929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 655/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:00:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 30 12:00:24.443460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048eb8c-e8e0-480a-8d84-d8f03a76f076 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:24.537295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:24.544016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048eb8c-e8e0-480a-8d84-d8f03a76f076 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:24.578309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:24.579135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:24.579428 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:24.579709 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:24.580361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:24.581746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 30 12:00:24.594448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 30 12:00:24.595645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 30 12:00:24.596515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 649/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 30 12:00:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 30 12:00:24.601763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cac429-1608-4397-9d43-58b7c91768f2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:24.675133 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:24.697333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cac429-1608-4397-9d43-58b7c91768f2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:24.728729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb24e1-0545-4858-9433-3a2f728f93f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:24.729383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb24e1-0545-4858-9433-3a2f728f93f0 None admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:24.729665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb24e1-0545-4858-9433-3a2f728f93f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:24.729939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb24e1-0545-4858-9433-3a2f728f93f0 None admin] PATH_INFO: `/v3/services` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:24.730696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb24e1-0545-4858-9433-3a2f728f93f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:00:24.730975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb24e1-0545-4858-9433-3a2f728f93f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:24.732336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb24e1-0545-4858-9433-3a2f728f93f0 None admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:24.737706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 656/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 30 12:00:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:00:24.743997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:00:24.844430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863e2e1-e776-4292-90ce-3bcbfda824b9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:00:24.877404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cb4f0-247b-42a6-b4e6-d5a3d4bfd592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:00:24.878090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cb4f0-247b-42a6-b4e6-d5a3d4bfd592 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:00:24.878373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cb4f0-247b-42a6-b4e6-d5a3d4bfd592 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:00:24.878658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cb4f0-247b-42a6-b4e6-d5a3d4bfd592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:00:24.879422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cb4f0-247b-42a6-b4e6-d5a3d4bfd592 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:00:24.880787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cb4f0-247b-42a6-b4e6-d5a3d4bfd592 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:00:24.954900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 650/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 30 12:00:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:00:34.772763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=30 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:34.950339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:15.763939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a633c75-a9ab-4587-a845-eb99211a490c None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:15.764404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a633c75-a9ab-4587-a845-eb99211a490c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:15.764489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a633c75-a9ab-4587-a845-eb99211a490c None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:15.770259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 657/1307] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:15.771736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3f41-7b46-416f-888b-2d622584b3d9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:15.772112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3f41-7b46-416f-888b-2d622584b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:15.772240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3f41-7b46-416f-888b-2d622584b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:15.888183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6e2b3f41-7b46-416f-888b-2d622584b3d9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:15.890681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6e2b3f41-7b46-416f-888b-2d622584b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:16.037646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 651/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:16.091590 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d014-ae71-433b-aeb4-e41f2875e1e2 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:16.091877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d014-ae71-433b-aeb4-e41f2875e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:16.092322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d014-ae71-433b-aeb4-e41f2875e1e2 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:16.093893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 658/1309] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 30 12:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:16.101184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9945-f9ca-4684-80fb-e91a5e22ee86 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:16.101829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9945-f9ca-4684-80fb-e91a5e22ee86 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:16.102217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9945-f9ca-4684-80fb-e91a5e22ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:16.186598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e69e9945-f9ca-4684-80fb-e91a5e22ee86 None None] MFA Rules not processed for user `35763651d4614bf68400b5efce4113a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:16.187810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e69e9945-f9ca-4684-80fb-e91a5e22ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:16.211318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:16.269354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 652/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 30 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:16.279236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6d014-ae71-433b-aeb4-e41f2875e1e2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:16.281095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3bc6d014-ae71-433b-aeb4-e41f2875e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:16.532859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6d014-ae71-433b-aeb4-e41f2875e1e2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:16.610212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a5016-6a11-4150-8b2e-9c3d09b6ac97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:16.610874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5016-6a11-4150-8b2e-9c3d09b6ac97 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:16.611153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5016-6a11-4150-8b2e-9c3d09b6ac97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:16.611426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5016-6a11-4150-8b2e-9c3d09b6ac97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:16.613070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-801a5016-6a11-4150-8b2e-9c3d09b6ac97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:16.669406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:16.725633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a5016-6a11-4150-8b2e-9c3d09b6ac97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:16.727116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a5016-6a11-4150-8b2e-9c3d09b6ac97 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:16.747627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 659/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:06:19.283587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a20b78-d79b-465d-8ec7-9763b043aa36 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:19.284103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a20b78-d79b-465d-8ec7-9763b043aa36 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:19.284184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a20b78-d79b-465d-8ec7-9763b043aa36 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:19.286001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 653/1312] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:19.290964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4593b-5319-4b65-88b8-0220c7cc6cf3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:19.291378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4593b-5319-4b65-88b8-0220c7cc6cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:19.291548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4593b-5319-4b65-88b8-0220c7cc6cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:19.374759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-38a4593b-5319-4b65-88b8-0220c7cc6cf3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:19.376624 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-38a4593b-5319-4b65-88b8-0220c7cc6cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:19.492731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 660/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:19.531779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a20b78-d79b-465d-8ec7-9763b043aa36 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:19.533363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-69a20b78-d79b-465d-8ec7-9763b043aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:19.662719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a20b78-d79b-465d-8ec7-9763b043aa36 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:19.739126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:19.741907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcac19-f183-4ac1-a56e-8e82b585830c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:19.742590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcac19-f183-4ac1-a56e-8e82b585830c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:19.742881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcac19-f183-4ac1-a56e-8e82b585830c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:19.743197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcac19-f183-4ac1-a56e-8e82b585830c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:19.744837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aefcac19-f183-4ac1-a56e-8e82b585830c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:19.863907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcac19-f183-4ac1-a56e-8e82b585830c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:19.865364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcac19-f183-4ac1-a56e-8e82b585830c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:19.884104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 654/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:22.727734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2222b7-c79c-4121-b730-21e0d1c7e086 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:22.728385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2222b7-c79c-4121-b730-21e0d1c7e086 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:22.728385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2222b7-c79c-4121-b730-21e0d1c7e086 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:22.729839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 661/1315] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:22.735002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8840-a0fd-426a-b936-8a8ac1f02c3f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:22.735432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8840-a0fd-426a-b936-8a8ac1f02c3f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:22.735578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8840-a0fd-426a-b936-8a8ac1f02c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:22.799927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-75ca8840-a0fd-426a-b936-8a8ac1f02c3f None None] MFA Rules not processed for user `a941a87e586f4f72ade6be453d0effa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:22.801157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-75ca8840-a0fd-426a-b936-8a8ac1f02c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:22.852182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:22.897612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 655/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:22.937445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2222b7-c79c-4121-b730-21e0d1c7e086 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:22.939012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8f2222b7-c79c-4121-b730-21e0d1c7e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:22.949104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:23.040205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2222b7-c79c-4121-b730-21e0d1c7e086 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:23.110766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185c80a-c7b3-439a-ae5e-c65dea64b50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:23.111401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185c80a-c7b3-439a-ae5e-c65dea64b50a service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:23.111686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185c80a-c7b3-439a-ae5e-c65dea64b50a service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:23.111964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185c80a-c7b3-439a-ae5e-c65dea64b50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:23.113621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b185c80a-c7b3-439a-ae5e-c65dea64b50a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:23.173308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:23.219717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185c80a-c7b3-439a-ae5e-c65dea64b50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:23.221160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185c80a-c7b3-439a-ae5e-c65dea64b50a service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:23.239179 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 662/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:26.312261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97fa3-6d41-46ff-acb8-cc5bf67220a0 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:26.312821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97fa3-6d41-46ff-acb8-cc5bf67220a0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:26.312821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97fa3-6d41-46ff-acb8-cc5bf67220a0 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:26.314216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 656/1318] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:26.319353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef80e9-13ea-43e9-9318-709b75295ea0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:26.319787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef80e9-13ea-43e9-9318-709b75295ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:26.319950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef80e9-13ea-43e9-9318-709b75295ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:26.382857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-dcef80e9-13ea-43e9-9318-709b75295ea0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:26.384089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-dcef80e9-13ea-43e9-9318-709b75295ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:26.478979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 663/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:26.517157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c97fa3-6d41-46ff-acb8-cc5bf67220a0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:26.518836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-15c97fa3-6d41-46ff-acb8-cc5bf67220a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:26.622242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c97fa3-6d41-46ff-acb8-cc5bf67220a0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:26.694447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566419-3b31-4f58-a037-28f07e213fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:26.695092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566419-3b31-4f58-a037-28f07e213fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:26.695381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566419-3b31-4f58-a037-28f07e213fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:26.695660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566419-3b31-4f58-a037-28f07e213fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:26.697333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1c566419-3b31-4f58-a037-28f07e213fa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:26.705691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:26.931706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566419-3b31-4f58-a037-28f07e213fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:26.933324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566419-3b31-4f58-a037-28f07e213fa9 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:26.951349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 657/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:30.279906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d339-0486-44d6-b754-afc233f7d36a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.280476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d339-0486-44d6-b754-afc233f7d36a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.280574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d339-0486-44d6-b754-afc233f7d36a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.281922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 664/1321] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:30.287264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1623e20-35f1-491f-a4f6-f9d3bb3e38cf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.287662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1623e20-35f1-491f-a4f6-f9d3bb3e38cf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.287821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1623e20-35f1-491f-a4f6-f9d3bb3e38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.352185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b1623e20-35f1-491f-a4f6-f9d3bb3e38cf None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:30.353383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b1623e20-35f1-491f-a4f6-f9d3bb3e38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.409163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:30.449441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 658/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:30.485019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78d339-0486-44d6-b754-afc233f7d36a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:30.486727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1d78d339-0486-44d6-b754-afc233f7d36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.506403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:30.591126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78d339-0486-44d6-b754-afc233f7d36a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:30.664592 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ed9dd-b385-43fe-99f6-9a268a0af99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:30.665245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ed9dd-b385-43fe-99f6-9a268a0af99d service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:30.665533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ed9dd-b385-43fe-99f6-9a268a0af99d service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:30.665812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ed9dd-b385-43fe-99f6-9a268a0af99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:30.667502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b77ed9dd-b385-43fe-99f6-9a268a0af99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:30.740240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:30.781573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ed9dd-b385-43fe-99f6-9a268a0af99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:30.783097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ed9dd-b385-43fe-99f6-9a268a0af99d service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:30.802369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 665/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:33.081568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408be3-b90b-42c7-bff3-72214788bf5b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.082148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408be3-b90b-42c7-bff3-72214788bf5b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.082148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408be3-b90b-42c7-bff3-72214788bf5b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.083518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 659/1324] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:33.088841 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e6f2-1fca-4ab8-b49f-c5fe9f3ec33e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.089264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e6f2-1fca-4ab8-b49f-c5fe9f3ec33e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.089426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e6f2-1fca-4ab8-b49f-c5fe9f3ec33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.153358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0a86e6f2-1fca-4ab8-b49f-c5fe9f3ec33e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:33.154594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0a86e6f2-1fca-4ab8-b49f-c5fe9f3ec33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:33.252153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 666/1325] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:33.287927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408be3-b90b-42c7-bff3-72214788bf5b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:33.289484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-70408be3-b90b-42c7-bff3-72214788bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:33.394127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408be3-b90b-42c7-bff3-72214788bf5b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:33.467520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b7321-997f-42f2-b23d-4ec819009a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:33.468159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7321-997f-42f2-b23d-4ec819009a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:33.468438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7321-997f-42f2-b23d-4ec819009a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:33.468711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7321-997f-42f2-b23d-4ec819009a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:33.470380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6c2b7321-997f-42f2-b23d-4ec819009a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:33.486949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:33.578109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b7321-997f-42f2-b23d-4ec819009a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:33.579565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b7321-997f-42f2-b23d-4ec819009a54 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:33.598167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 660/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:35.881308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fae0-61ee-4e3b-a904-72084c3a8376 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:35.881939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fae0-61ee-4e3b-a904-72084c3a8376 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:35.881939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fae0-61ee-4e3b-a904-72084c3a8376 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:35.883414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 667/1327] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:06:35.888442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013af34-1745-4030-9cea-5d2884f691b4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:35.888879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013af34-1745-4030-9cea-5d2884f691b4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:35.888993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013af34-1745-4030-9cea-5d2884f691b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:35.952462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4013af34-1745-4030-9cea-5d2884f691b4 None None] MFA Rules not processed for user `a941a87e586f4f72ade6be453d0effa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:35.953574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4013af34-1745-4030-9cea-5d2884f691b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:36.017542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:36.049043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 661/1328] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:36.087478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60fae0-61ee-4e3b-a904-72084c3a8376 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:36.089129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2d60fae0-61ee-4e3b-a904-72084c3a8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:36.120117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:36.197366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60fae0-61ee-4e3b-a904-72084c3a8376 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:36.272231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eb117-8dae-458f-9d71-da4f38594d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:36.272877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb117-8dae-458f-9d71-da4f38594d74 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:36.273164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb117-8dae-458f-9d71-da4f38594d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:36.273446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eb117-8dae-458f-9d71-da4f38594d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:36.275130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-221eb117-8dae-458f-9d71-da4f38594d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:36.354951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:36.386675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eb117-8dae-458f-9d71-da4f38594d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:36.388129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eb117-8dae-458f-9d71-da4f38594d74 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:36.405890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 668/1329] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:39.055780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afc44-3e06-4141-85ee-c08c9991c744 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.056270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afc44-3e06-4141-85ee-c08c9991c744 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.056377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afc44-3e06-4141-85ee-c08c9991c744 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.057929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 662/1330] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:39.063413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa24d-94ba-44ee-a29c-cd0a0626dc80 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.063904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa24d-94ba-44ee-a29c-cd0a0626dc80 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.064014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa24d-94ba-44ee-a29c-cd0a0626dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.129414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8d5aa24d-94ba-44ee-a29c-cd0a0626dc80 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:39.130636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8d5aa24d-94ba-44ee-a29c-cd0a0626dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:39.227676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 669/1331] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:39.264293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afc44-3e06-4141-85ee-c08c9991c744 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:39.265849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-616afc44-3e06-4141-85ee-c08c9991c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:39.370110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afc44-3e06-4141-85ee-c08c9991c744 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:39.442685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b66ed-5fef-4d60-80f0-1678ad86ff88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:39.443339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b66ed-5fef-4d60-80f0-1678ad86ff88 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:39.443628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b66ed-5fef-4d60-80f0-1678ad86ff88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:39.443905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b66ed-5fef-4d60-80f0-1678ad86ff88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:39.445600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-580b66ed-5fef-4d60-80f0-1678ad86ff88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:39.472004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:39.553685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b66ed-5fef-4d60-80f0-1678ad86ff88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:39.555325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b66ed-5fef-4d60-80f0-1678ad86ff88 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:39.575021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 663/1332] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:41.877512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c8b4-2fd6-4d34-b367-8515b01f8501 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:41.878024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c8b4-2fd6-4d34-b367-8515b01f8501 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:41.878119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c8b4-2fd6-4d34-b367-8515b01f8501 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:41.879986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 670/1333] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:41.885233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd312-4341-4c90-8639-f5876e6e75e2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:41.885652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd312-4341-4c90-8639-f5876e6e75e2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:41.885791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dd312-4341-4c90-8639-f5876e6e75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:41.950299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2c0dd312-4341-4c90-8639-f5876e6e75e2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:41.951424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2c0dd312-4341-4c90-8639-f5876e6e75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:42.023883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:42.045304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 664/1334] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:42.086096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c8b4-2fd6-4d34-b367-8515b01f8501 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:42.087673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c869c8b4-2fd6-4d34-b367-8515b01f8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:42.127208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:42.190074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c8b4-2fd6-4d34-b367-8515b01f8501 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:42.261934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e2c06-55e0-4d62-9adc-5a933291c2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:42.262608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e2c06-55e0-4d62-9adc-5a933291c2fe service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:42.262893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e2c06-55e0-4d62-9adc-5a933291c2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:42.263174 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e2c06-55e0-4d62-9adc-5a933291c2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:42.264819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9b0e2c06-55e0-4d62-9adc-5a933291c2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:42.346321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:42.371932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e2c06-55e0-4d62-9adc-5a933291c2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:42.373363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e2c06-55e0-4d62-9adc-5a933291c2fe service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:42.391008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 671/1335] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:06:45.180591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24a591-9650-4f4b-a200-f993b0651371 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:45.181095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24a591-9650-4f4b-a200-f993b0651371 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:45.181095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24a591-9650-4f4b-a200-f993b0651371 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:45.182761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 665/1336] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:45.187942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb990bc-17c4-45e8-a2cd-824cb75b1732 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:45.188381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb990bc-17c4-45e8-a2cd-824cb75b1732 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:45.188513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb990bc-17c4-45e8-a2cd-824cb75b1732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:45.256143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-edb990bc-17c4-45e8-a2cd-824cb75b1732 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:45.257394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-edb990bc-17c4-45e8-a2cd-824cb75b1732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:45.353388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 672/1337] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:45.405124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1e7f-d583-436d-af37-70171079dac1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:45.405485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1e7f-d583-436d-af37-70171079dac1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:45.405771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1e7f-d583-436d-af37-70171079dac1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:45.407215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 666/1338] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 30 12:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:45.413474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fa1f5-43b7-4c37-8960-c4443ab0beb3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:45.413767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fa1f5-43b7-4c37-8960-c4443ab0beb3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:45.414079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fa1f5-43b7-4c37-8960-c4443ab0beb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:45.466998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:45.489305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d29fa1f5-43b7-4c37-8960-c4443ab0beb3 None None] MFA Rules not processed for user `35763651d4614bf68400b5efce4113a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:45.490555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d29fa1f5-43b7-4c37-8960-c4443ab0beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:45.566275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 673/1339] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 30 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:45.575454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c1e7f-d583-436d-af37-70171079dac1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:45.577179 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e02c1e7f-d583-436d-af37-70171079dac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:45.679555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c1e7f-d583-436d-af37-70171079dac1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:45.757784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c45b9c-ea3f-4b92-95f6-e405bc6097c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:45.758519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45b9c-ea3f-4b92-95f6-e405bc6097c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:45.758806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45b9c-ea3f-4b92-95f6-e405bc6097c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:45.759087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45b9c-ea3f-4b92-95f6-e405bc6097c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:45.760878 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-36c45b9c-ea3f-4b92-95f6-e405bc6097c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:45.800921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:45.874326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c45b9c-ea3f-4b92-95f6-e405bc6097c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:45.875846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c45b9c-ea3f-4b92-95f6-e405bc6097c3 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:45.894497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 667/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:50.885486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa40475-d13f-41cc-bc02-ec3a029769aa None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.886075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa40475-d13f-41cc-bc02-ec3a029769aa None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.886165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa40475-d13f-41cc-bc02-ec3a029769aa None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.887696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 674/1341] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:50.893349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779455e-1457-44be-8c95-c7e13e48a370 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:50.893349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779455e-1457-44be-8c95-c7e13e48a370 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:50.893349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779455e-1457-44be-8c95-c7e13e48a370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:50.967538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c779455e-1457-44be-8c95-c7e13e48a370 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:50.968736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c779455e-1457-44be-8c95-c7e13e48a370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:51.059424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:51.071792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 668/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:51.111046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa40475-d13f-41cc-bc02-ec3a029769aa None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:51.113353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1aa40475-d13f-41cc-bc02-ec3a029769aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:51.207706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa40475-d13f-41cc-bc02-ec3a029769aa None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:51.211368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f25cb-003b-4fe9-ac66-145bb53a8346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:51.212011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f25cb-003b-4fe9-ac66-145bb53a8346 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:51.212292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f25cb-003b-4fe9-ac66-145bb53a8346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:51.212565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f25cb-003b-4fe9-ac66-145bb53a8346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:51.221518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f25cb-003b-4fe9-ac66-145bb53a8346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:51.223581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f25cb-003b-4fe9-ac66-145bb53a8346 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:51.232768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 675/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:54.466874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334877c5-6d61-4612-90f7-37e00e36c839 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.467469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334877c5-6d61-4612-90f7-37e00e36c839 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.467469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334877c5-6d61-4612-90f7-37e00e36c839 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.468807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 669/1344] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:54.474147 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76a80-3117-417c-986e-3cd24702d901 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.474576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76a80-3117-417c-986e-3cd24702d901 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.474719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76a80-3117-417c-986e-3cd24702d901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.502406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c8e76a80-3117-417c-986e-3cd24702d901 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:54.504122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c8e76a80-3117-417c-986e-3cd24702d901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:54.534095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:54.585897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 676/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:54.623683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334877c5-6d61-4612-90f7-37e00e36c839 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:54.635268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334877c5-6d61-4612-90f7-37e00e36c839 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:54.638812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92578b8-28b1-487a-b5b2-63e3874249f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:54.639450 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92578b8-28b1-487a-b5b2-63e3874249f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:54.639737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92578b8-28b1-487a-b5b2-63e3874249f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:54.640118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92578b8-28b1-487a-b5b2-63e3874249f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:54.649524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92578b8-28b1-487a-b5b2-63e3874249f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:54.651031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92578b8-28b1-487a-b5b2-63e3874249f6 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:54.660935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 670/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:06:58.990295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943888b5-5202-4ce6-a306-a97e66dc27ea None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:58.990848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943888b5-5202-4ce6-a306-a97e66dc27ea None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:58.990848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943888b5-5202-4ce6-a306-a97e66dc27ea None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:58.992274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 677/1347] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:06:58.997525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095c078-f076-4ad7-bcad-233d31510674 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:58.997982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095c078-f076-4ad7-bcad-233d31510674 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:58.998119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095c078-f076-4ad7-bcad-233d31510674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:59.016031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3095c078-f076-4ad7-bcad-233d31510674 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:06:59.017143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3095c078-f076-4ad7-bcad-233d31510674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:06:59.025520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 671/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:06:59.063192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943888b5-5202-4ce6-a306-a97e66dc27ea None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:06:59.074268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943888b5-5202-4ce6-a306-a97e66dc27ea None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:06:59.077680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d863ead-6dfb-4c11-895c-2b32e7d30f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:06:59.078343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d863ead-6dfb-4c11-895c-2b32e7d30f60 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:06:59.078630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d863ead-6dfb-4c11-895c-2b32e7d30f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:06:59.078908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d863ead-6dfb-4c11-895c-2b32e7d30f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:06:59.089104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d863ead-6dfb-4c11-895c-2b32e7d30f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:06:59.090570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d863ead-6dfb-4c11-895c-2b32e7d30f60 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:06:59.100390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 678/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:04.511781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9fb3-70c9-43b4-b76b-9686bebc7e66 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:04.512860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9fb3-70c9-43b4-b76b-9686bebc7e66 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:04.513491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9fb3-70c9-43b4-b76b-9686bebc7e66 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:04.515497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 672/1350] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:07:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:04.521378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ab8a-dd69-462f-b483-3980dfbb04ed None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:04.522190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ab8a-dd69-462f-b483-3980dfbb04ed None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:04.522661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ab8a-dd69-462f-b483-3980dfbb04ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:04.604571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7192ab8a-dd69-462f-b483-3980dfbb04ed None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:04.606191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7192ab8a-dd69-462f-b483-3980dfbb04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:04.713171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 679/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:07:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:09.010976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=13 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:09.121429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead101-fdb6-4d13-a756-fb110c87685e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.121724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead101-fdb6-4d13-a756-fb110c87685e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.122228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead101-fdb6-4d13-a756-fb110c87685e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.123729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 673/1352] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:09.129115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4a70e-1907-4c2b-a23b-9c6e99bee5ed None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:09.129559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4a70e-1907-4c2b-a23b-9c6e99bee5ed None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:09.129813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4a70e-1907-4c2b-a23b-9c6e99bee5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:09.148858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2fe4a70e-1907-4c2b-a23b-9c6e99bee5ed None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:09.150145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2fe4a70e-1907-4c2b-a23b-9c6e99bee5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:09.162108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 680/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:07:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:10.553672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850afd-6813-4c6a-aae7-e3f56a462965 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:10.554260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850afd-6813-4c6a-aae7-e3f56a462965 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:10.554260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850afd-6813-4c6a-aae7-e3f56a462965 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:10.555614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 674/1354] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:10.560785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9366-14b1-42fb-95a1-647b25d81faa None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:10.561185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9366-14b1-42fb-95a1-647b25d81faa None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:10.561513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9366-14b1-42fb-95a1-647b25d81faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:10.581144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-e57f9366-14b1-42fb-95a1-647b25d81faa None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:10.582432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e57f9366-14b1-42fb-95a1-647b25d81faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:10.591230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 681/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:14.402132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1aa08-e8ef-4bf5-b33e-d2474978b5db None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.402960 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1aa08-e8ef-4bf5-b33e-d2474978b5db None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.403405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1aa08-e8ef-4bf5-b33e-d2474978b5db None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.406350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 675/1356] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:14.412585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94277f7-3306-4c34-9d2a-02eb69fbba17 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.413080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94277f7-3306-4c34-9d2a-02eb69fbba17 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.413179 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94277f7-3306-4c34-9d2a-02eb69fbba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.436638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c94277f7-3306-4c34-9d2a-02eb69fbba17 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:14.438120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c94277f7-3306-4c34-9d2a-02eb69fbba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.446197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 682/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:14.499851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7774fd-2c21-4d18-95e5-09ccb4e86166 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.500143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7774fd-2c21-4d18-95e5-09ccb4e86166 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.500424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7774fd-2c21-4d18-95e5-09ccb4e86166 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.501786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 676/1358] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 30 12:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:14.509496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd3c1-d775-4770-9298-68b007dfdd2f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.510319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd3c1-d775-4770-9298-68b007dfdd2f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.511011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd3c1-d775-4770-9298-68b007dfdd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.556313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:14.565194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-03abd3c1-d775-4770-9298-68b007dfdd2f None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:14.566511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-03abd3c1-d775-4770-9298-68b007dfdd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:14.654191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 683/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 30 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:14.657819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7774fd-2c21-4d18-95e5-09ccb4e86166 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:14.675286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7774fd-2c21-4d18-95e5-09ccb4e86166 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:14.681332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc064-2588-4216-9a38-bcccca272681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:14.681985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc064-2588-4216-9a38-bcccca272681 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:14.682347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc064-2588-4216-9a38-bcccca272681 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:14.682640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc064-2588-4216-9a38-bcccca272681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:14.692632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdc064-2588-4216-9a38-bcccca272681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:14.694368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdc064-2588-4216-9a38-bcccca272681 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:14.704770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 677/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:07:17.185660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fb45e-696e-4360-a32a-d663dba09169 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.186234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fb45e-696e-4360-a32a-d663dba09169 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.186234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fb45e-696e-4360-a32a-d663dba09169 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.187763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 684/1361] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:17.192910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237455-177d-45aa-8abf-cf728dff525d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.193304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237455-177d-45aa-8abf-cf728dff525d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.193462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237455-177d-45aa-8abf-cf728dff525d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.211545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cb237455-177d-45aa-8abf-cf728dff525d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:17.212733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb237455-177d-45aa-8abf-cf728dff525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:17.224314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 678/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:17.263837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fb45e-696e-4360-a32a-d663dba09169 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:17.280700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fb45e-696e-4360-a32a-d663dba09169 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:17.290640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79518e-658b-43d7-a0d9-70ee701984a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:17.291306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79518e-658b-43d7-a0d9-70ee701984a6 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:17.291598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79518e-658b-43d7-a0d9-70ee701984a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:17.291879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79518e-658b-43d7-a0d9-70ee701984a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:17.301096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79518e-658b-43d7-a0d9-70ee701984a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:17.302702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79518e-658b-43d7-a0d9-70ee701984a6 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:17.312944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 685/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:20.012652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263cfd-4161-453f-bfe4-b67242b1109b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:20.013164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263cfd-4161-453f-bfe4-b67242b1109b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:20.013648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263cfd-4161-453f-bfe4-b67242b1109b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:20.015451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 679/1364] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:20.021050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d755e9-2439-444f-ad91-a1d2c19b17af None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:20.022033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d755e9-2439-444f-ad91-a1d2c19b17af None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:20.022599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d755e9-2439-444f-ad91-a1d2c19b17af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:20.043306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-88d755e9-2439-444f-ad91-a1d2c19b17af None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:20.044592 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-88d755e9-2439-444f-ad91-a1d2c19b17af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:20.053445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 686/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:20.099739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522fc9c-9d77-4e91-9cf7-7736bed2c1a7 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:20.099899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522fc9c-9d77-4e91-9cf7-7736bed2c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:20.100163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522fc9c-9d77-4e91-9cf7-7736bed2c1a7 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:20.101533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 680/1366] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 30 12:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:20.106778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afd58f-391b-4f04-be22-fd943d410b59 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:20.107072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afd58f-391b-4f04-be22-fd943d410b59 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:20.107355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afd58f-391b-4f04-be22-fd943d410b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:20.125910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-46afd58f-391b-4f04-be22-fd943d410b59 None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:20.127128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-46afd58f-391b-4f04-be22-fd943d410b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:20.136698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 687/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 30 12:07:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:20.144621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522fc9c-9d77-4e91-9cf7-7736bed2c1a7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:20.159228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522fc9c-9d77-4e91-9cf7-7736bed2c1a7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:20.164836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b6ccf-9320-4790-8c2a-434fb05530c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:20.165467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6ccf-9320-4790-8c2a-434fb05530c6 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:20.165757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6ccf-9320-4790-8c2a-434fb05530c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:20.166143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6ccf-9320-4790-8c2a-434fb05530c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:20.174899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b6ccf-9320-4790-8c2a-434fb05530c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:20.176851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b6ccf-9320-4790-8c2a-434fb05530c6 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:20.186406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 681/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:22.707993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0525ea-0bb9-499d-9fd4-cdeb1405ee93 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:22.709056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0525ea-0bb9-499d-9fd4-cdeb1405ee93 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:22.709556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0525ea-0bb9-499d-9fd4-cdeb1405ee93 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:22.711327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 688/1369] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:22.717492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b5b3-534e-4c3f-9a77-97c1a5294802 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:22.718504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b5b3-534e-4c3f-9a77-97c1a5294802 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:22.718896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b5b3-534e-4c3f-9a77-97c1a5294802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:22.721263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb76-d9c1-43c8-b943-cceeda6a5211 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:22.721553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb76-d9c1-43c8-b943-cceeda6a5211 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:22.721842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb76-d9c1-43c8-b943-cceeda6a5211 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:22.723418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 689/1370] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:07:22.728978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a5fc-c937-427c-8553-4c5694b881d0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:22.729646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a5fc-c937-427c-8553-4c5694b881d0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:22.730128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a5fc-c937-427c-8553-4c5694b881d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:22.742822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4625b5b3-534e-4c3f-9a77-97c1a5294802 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:22.744019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4625b5b3-534e-4c3f-9a77-97c1a5294802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:22.749884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0942a5fc-c937-427c-8553-4c5694b881d0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:22.752492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0942a5fc-c937-427c-8553-4c5694b881d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:22.756584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 682/1371] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:22.762292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 690/1372] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:22.801377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625b5b3-534e-4c3f-9a77-97c1a5294802 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:22.814964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625b5b3-534e-4c3f-9a77-97c1a5294802 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:22.820582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f77f75-0483-453f-ab34-c6884e385e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:22.821358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77f75-0483-453f-ab34-c6884e385e4b service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:22.821746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77f75-0483-453f-ab34-c6884e385e4b service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:22.822154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77f75-0483-453f-ab34-c6884e385e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:22.831803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f77f75-0483-453f-ab34-c6884e385e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:22.833546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f77f75-0483-453f-ab34-c6884e385e4b service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:22.843686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 683/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:23.034864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785837d-9129-4678-8271-d483ee4e42d6 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:23.035166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785837d-9129-4678-8271-d483ee4e42d6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:23.035451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785837d-9129-4678-8271-d483ee4e42d6 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:23.036863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 691/1374] 10.222.0.48 () {54 vars in 963 bytes} [Mon May 30 12:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:23.041781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bcb11-c0d9-4055-ac27-1044b93a5383 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:23.042126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bcb11-c0d9-4055-ac27-1044b93a5383 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:23.042409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bcb11-c0d9-4055-ac27-1044b93a5383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:23.111935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6f8bcb11-c0d9-4055-ac27-1044b93a5383 None None] MFA Rules not processed for user `a4d11748f14d40628414db49de696fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:23.113165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6f8bcb11-c0d9-4055-ac27-1044b93a5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:23.182416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 684/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Mon May 30 12:07:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:23.193729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785837d-9129-4678-8271-d483ee4e42d6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:23.205587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785837d-9129-4678-8271-d483ee4e42d6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:23.209367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8bfb1-62e2-49e6-a671-14cabebb99ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:23.210086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8bfb1-62e2-49e6-a671-14cabebb99ea service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:23.210373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8bfb1-62e2-49e6-a671-14cabebb99ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:23.210654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8bfb1-62e2-49e6-a671-14cabebb99ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:23.221313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8bfb1-62e2-49e6-a671-14cabebb99ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:23.222817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8bfb1-62e2-49e6-a671-14cabebb99ea service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:23.233601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 692/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:25.309552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffe197-b1c0-4691-a2c0-31aaedcb1630 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:25.310198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffe197-b1c0-4691-a2c0-31aaedcb1630 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:25.310198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffe197-b1c0-4691-a2c0-31aaedcb1630 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:25.311669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 685/1377] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:25.318374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a5d4c-dc59-4653-b910-04cc51bb6f74 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:25.318944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a5d4c-dc59-4653-b910-04cc51bb6f74 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:25.318944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a5d4c-dc59-4653-b910-04cc51bb6f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:25.338254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b66a5d4c-dc59-4653-b910-04cc51bb6f74 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:25.339530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b66a5d4c-dc59-4653-b910-04cc51bb6f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:25.347627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 693/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:25.392469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffe197-b1c0-4691-a2c0-31aaedcb1630 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:25.407162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffe197-b1c0-4691-a2c0-31aaedcb1630 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:25.412663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc17f4a-c604-403e-bb06-e1fd0c5c0583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:25.413304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc17f4a-c604-403e-bb06-e1fd0c5c0583 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:25.413592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc17f4a-c604-403e-bb06-e1fd0c5c0583 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:25.413873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc17f4a-c604-403e-bb06-e1fd0c5c0583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:25.422558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc17f4a-c604-403e-bb06-e1fd0c5c0583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:25.424160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc17f4a-c604-403e-bb06-e1fd0c5c0583 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:25.434021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 686/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:27.847528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a6238-7f6a-4f02-9846-349cc6fd0dae None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:27.848086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a6238-7f6a-4f02-9846-349cc6fd0dae None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:27.848086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a6238-7f6a-4f02-9846-349cc6fd0dae None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:27.849468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 694/1380] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:27.854655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100184-df4c-4af0-9b11-2387e138e0f3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:27.855040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100184-df4c-4af0-9b11-2387e138e0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:27.855216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100184-df4c-4af0-9b11-2387e138e0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:27.873443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ff100184-df4c-4af0-9b11-2387e138e0f3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:27.874850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ff100184-df4c-4af0-9b11-2387e138e0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:27.882954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 687/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:27.927287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a6238-7f6a-4f02-9846-349cc6fd0dae None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:27.942518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a6238-7f6a-4f02-9846-349cc6fd0dae None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:27.947914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c9494-9d55-4b07-889b-5e310cd9c7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:27.948632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9494-9d55-4b07-889b-5e310cd9c7cb service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:27.948978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9494-9d55-4b07-889b-5e310cd9c7cb service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:27.949325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9494-9d55-4b07-889b-5e310cd9c7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:27.958052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c9494-9d55-4b07-889b-5e310cd9c7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:27.959652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c9494-9d55-4b07-889b-5e310cd9c7cb service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:27.969488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 695/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:30.387048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c672-78c3-4b08-8103-da5eb2f7d842 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.387619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c672-78c3-4b08-8103-da5eb2f7d842 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.387619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c672-78c3-4b08-8103-da5eb2f7d842 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.390277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 688/1383] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:30.394588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0f91-9e6f-4162-8103-9dcb2d56794e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.395039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0f91-9e6f-4162-8103-9dcb2d56794e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.395333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0f91-9e6f-4162-8103-9dcb2d56794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.413900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-246b0f91-9e6f-4162-8103-9dcb2d56794e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:30.415510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-246b0f91-9e6f-4162-8103-9dcb2d56794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:30.426391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 696/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:07:30.465097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796c672-78c3-4b08-8103-da5eb2f7d842 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:30.481918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796c672-78c3-4b08-8103-da5eb2f7d842 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:30.488259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69140-14a6-40e4-a7b4-e1a316c96be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:30.489071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69140-14a6-40e4-a7b4-e1a316c96be7 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:30.489489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69140-14a6-40e4-a7b4-e1a316c96be7 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:30.489909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69140-14a6-40e4-a7b4-e1a316c96be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:30.498924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e69140-14a6-40e4-a7b4-e1a316c96be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:30.500937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e69140-14a6-40e4-a7b4-e1a316c96be7 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:30.510920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 689/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:32.741785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a2423-9932-4e92-9a66-580686d14f06 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:32.742389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a2423-9932-4e92-9a66-580686d14f06 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:32.742642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a2423-9932-4e92-9a66-580686d14f06 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:32.744713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 697/1386] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:32.751997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cab49-d10c-435d-bc1b-24b68b20ac48 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:32.752454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cab49-d10c-435d-bc1b-24b68b20ac48 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:32.752697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cab49-d10c-435d-bc1b-24b68b20ac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:32.774286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-676cab49-d10c-435d-bc1b-24b68b20ac48 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:32.775921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-676cab49-d10c-435d-bc1b-24b68b20ac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:32.786372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 690/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:32.831786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a2423-9932-4e92-9a66-580686d14f06 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:32.847019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a2423-9932-4e92-9a66-580686d14f06 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:32.852287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698de30-fcf6-4e75-96f2-90ed42c9904b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:32.852926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698de30-fcf6-4e75-96f2-90ed42c9904b service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:32.853214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698de30-fcf6-4e75-96f2-90ed42c9904b service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:32.853490 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698de30-fcf6-4e75-96f2-90ed42c9904b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:32.862219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698de30-fcf6-4e75-96f2-90ed42c9904b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:32.863788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698de30-fcf6-4e75-96f2-90ed42c9904b service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:32.872940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 698/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:35.252363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b29b-5e0d-482a-9a46-2e1d731b56b4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.252999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b29b-5e0d-482a-9a46-2e1d731b56b4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.252999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b29b-5e0d-482a-9a46-2e1d731b56b4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.254339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 691/1389] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:07:35.261477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb041f-faa7-470e-99a6-7ac206e1a09a None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.261882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb041f-faa7-470e-99a6-7ac206e1a09a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.262255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb041f-faa7-470e-99a6-7ac206e1a09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.286341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c7bb041f-faa7-470e-99a6-7ac206e1a09a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:35.288046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c7bb041f-faa7-470e-99a6-7ac206e1a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:35.298482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 699/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:35.354584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33b29b-5e0d-482a-9a46-2e1d731b56b4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:35.372128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33b29b-5e0d-482a-9a46-2e1d731b56b4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:35.377583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480c658-a936-4ae9-a91a-226a7aed5d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:35.378256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c658-a936-4ae9-a91a-226a7aed5d3e service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:35.378540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c658-a936-4ae9-a91a-226a7aed5d3e service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:35.378817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c658-a936-4ae9-a91a-226a7aed5d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:35.387457 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480c658-a936-4ae9-a91a-226a7aed5d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:35.389044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480c658-a936-4ae9-a91a-226a7aed5d3e service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:35.399352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 692/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:37.773733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c16f0-3a6d-413c-8603-379954f1403d None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.774318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c16f0-3a6d-413c-8603-379954f1403d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.774318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c16f0-3a6d-413c-8603-379954f1403d None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.775696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 700/1392] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:37.781102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233b9b4-01d4-4adf-afb3-8b395e1d94ca None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.781556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233b9b4-01d4-4adf-afb3-8b395e1d94ca None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.781704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233b9b4-01d4-4adf-afb3-8b395e1d94ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.799881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0233b9b4-01d4-4adf-afb3-8b395e1d94ca None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:37.801067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0233b9b4-01d4-4adf-afb3-8b395e1d94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:37.809150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 693/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:37.853270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c16f0-3a6d-413c-8603-379954f1403d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:37.867577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c16f0-3a6d-413c-8603-379954f1403d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:37.872923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375eb15-9d77-4fbd-abd6-1cd6680348e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:37.873562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375eb15-9d77-4fbd-abd6-1cd6680348e3 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:37.873852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375eb15-9d77-4fbd-abd6-1cd6680348e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:37.874163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375eb15-9d77-4fbd-abd6-1cd6680348e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:37.882831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375eb15-9d77-4fbd-abd6-1cd6680348e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:37.884419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375eb15-9d77-4fbd-abd6-1cd6680348e3 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:37.894316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 701/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:39.430182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925902-d5e7-4455-a6d9-35046d427cfe None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:39.430819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925902-d5e7-4455-a6d9-35046d427cfe None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:39.430819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925902-d5e7-4455-a6d9-35046d427cfe None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:39.432138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 694/1395] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:39.437433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97a715-356f-49b2-8040-c7b72787077d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:39.437861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97a715-356f-49b2-8040-c7b72787077d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:39.438029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97a715-356f-49b2-8040-c7b72787077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:39.455388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4c97a715-356f-49b2-8040-c7b72787077d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:39.456585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4c97a715-356f-49b2-8040-c7b72787077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:39.464205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 702/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:39.519133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911bdc2-3e33-4c9b-b337-7beda8babd48 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:39.519518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911bdc2-3e33-4c9b-b337-7beda8babd48 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:39.519872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911bdc2-3e33-4c9b-b337-7beda8babd48 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:39.521378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 695/1397] 10.222.0.48 () {54 vars in 962 bytes} [Mon May 30 12:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:39.526561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609a13-6356-4265-a61c-ba4c7f6f7001 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:39.526878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609a13-6356-4265-a61c-ba4c7f6f7001 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:39.527160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609a13-6356-4265-a61c-ba4c7f6f7001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:39.568577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:39.576084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7f609a13-6356-4265-a61c-ba4c7f6f7001 None None] MFA Rules not processed for user `ca08d82f02a24e0088aceff2b6ba307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:39.577295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7f609a13-6356-4265-a61c-ba4c7f6f7001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:39.638109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 703/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Mon May 30 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:39.646018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911bdc2-3e33-4c9b-b337-7beda8babd48 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:39.651455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:39.657171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911bdc2-3e33-4c9b-b337-7beda8babd48 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:39.661262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70866-56ef-49eb-a529-5d328ba5cb19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca08d82f02a24e0088aceff2b6ba307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:39.661937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70866-56ef-49eb-a529-5d328ba5cb19 service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:39.662255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70866-56ef-49eb-a529-5d328ba5cb19 service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:39.662535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70866-56ef-49eb-a529-5d328ba5cb19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:39.671456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70866-56ef-49eb-a529-5d328ba5cb19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:39.673035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70866-56ef-49eb-a529-5d328ba5cb19 service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:39.683794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 696/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:40.247936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89c0ba-58c7-471d-93ce-3597f6856c04 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.248237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89c0ba-58c7-471d-93ce-3597f6856c04 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.248519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89c0ba-58c7-471d-93ce-3597f6856c04 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.249905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 704/1400] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:40.255176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad094c6-01de-46e1-b297-af51d1d7998a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.255487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad094c6-01de-46e1-b297-af51d1d7998a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.255751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad094c6-01de-46e1-b297-af51d1d7998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.274076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0ad094c6-01de-46e1-b297-af51d1d7998a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:40.275388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0ad094c6-01de-46e1-b297-af51d1d7998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:40.284036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 697/1401] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:40.322980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0d5e2-4eb1-4ba2-bc62-e7269e4724ca None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.323492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0d5e2-4eb1-4ba2-bc62-e7269e4724ca None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.323782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0d5e2-4eb1-4ba2-bc62-e7269e4724ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.329658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad094c6-01de-46e1-b297-af51d1d7998a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:40.341840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad094c6-01de-46e1-b297-af51d1d7998a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:40.348365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846837-3083-4c8a-8910-e081c5620f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:40.349083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846837-3083-4c8a-8910-e081c5620f95 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.349377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846837-3083-4c8a-8910-e081c5620f95 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.349656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846837-3083-4c8a-8910-e081c5620f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.358527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6846837-3083-4c8a-8910-e081c5620f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:40.360133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6846837-3083-4c8a-8910-e081c5620f95 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:40.370547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 698/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:40.373225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-a7f0d5e2-4eb1-4ba2-bc62-e7269e4724ca None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:40.374196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a7f0d5e2-4eb1-4ba2-bc62-e7269e4724ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:40.438434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 705/1403] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:40.480152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec9b9-9299-4811-8c03-7081955f6b40 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.480621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec9b9-9299-4811-8c03-7081955f6b40 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.480712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec9b9-9299-4811-8c03-7081955f6b40 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.482158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 699/1404] 10.222.0.48 () {54 vars in 942 bytes} [Mon May 30 12:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:07:40.491202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae6a8-d138-40ed-a495-244c77cba1d7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.491493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae6a8-d138-40ed-a495-244c77cba1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.491956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae6a8-d138-40ed-a495-244c77cba1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.542432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2efae6a8-d138-40ed-a495-244c77cba1d7 None None] MFA Rules not processed for user `8eb03f76d840406ebe2365fd092d72f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:40.543641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2efae6a8-d138-40ed-a495-244c77cba1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:40.590755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:40.617606 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 706/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Mon May 30 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:40.627298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec9b9-9299-4811-8c03-7081955f6b40 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:40.641097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec9b9-9299-4811-8c03-7081955f6b40 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:40.646575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba26940-e10c-4ed0-9916-384739de4b92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:40.647240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba26940-e10c-4ed0-9916-384739de4b92 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:40.647530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba26940-e10c-4ed0-9916-384739de4b92 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:40.647810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba26940-e10c-4ed0-9916-384739de4b92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:40.657064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba26940-e10c-4ed0-9916-384739de4b92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:40.660371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba26940-e10c-4ed0-9916-384739de4b92 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:40.668763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 700/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:07:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:07:42.987609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930997-5c70-406f-b5d2-ca1f6b2cd367 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.988168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930997-5c70-406f-b5d2-ca1f6b2cd367 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.988262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930997-5c70-406f-b5d2-ca1f6b2cd367 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:42.989827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 707/1407] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:07:42.995732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc26f-5a9d-42f7-bea0-f1b2b731315b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:42.996211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc26f-5a9d-42f7-bea0-f1b2b731315b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:42.996597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc26f-5a9d-42f7-bea0-f1b2b731315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:43.023007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ff0dc26f-5a9d-42f7-bea0-f1b2b731315b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:07:43.023007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ff0dc26f-5a9d-42f7-bea0-f1b2b731315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:07:43.032503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 701/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:07:43.077833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930997-5c70-406f-b5d2-ca1f6b2cd367 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:07:43.093866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930997-5c70-406f-b5d2-ca1f6b2cd367 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:07:43.104117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee0f17-fcd4-4eed-b213-ff74052ae327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:07:43.104880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee0f17-fcd4-4eed-b213-ff74052ae327 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:07:43.105174 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee0f17-fcd4-4eed-b213-ff74052ae327 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:07:43.105664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee0f17-fcd4-4eed-b213-ff74052ae327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:07:43.116734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee0f17-fcd4-4eed-b213-ff74052ae327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:07:43.118689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee0f17-fcd4-4eed-b213-ff74052ae327 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:07:43.129823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 708/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:07:53.087266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=23 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:53.139375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=15 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:04.775246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22595-c48b-4591-b563-31be0d4790f2 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.775776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22595-c48b-4591-b563-31be0d4790f2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.775882 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22595-c48b-4591-b563-31be0d4790f2 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.777230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 702/1410] 10.222.0.48 () {54 vars in 918 bytes} [Mon May 30 12:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:04.783021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebd09-aad1-4762-972e-328d09989af3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.783448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebd09-aad1-4762-972e-328d09989af3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.784675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebd09-aad1-4762-972e-328d09989af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.801744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-420ebd09-aad1-4762-972e-328d09989af3 None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:04.802982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-420ebd09-aad1-4762-972e-328d09989af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:04.811661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 709/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:04.826101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d20ef8-ff5d-4a67-98f9-85a7960911a0 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.826389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d20ef8-ff5d-4a67-98f9-85a7960911a0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.826693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d20ef8-ff5d-4a67-98f9-85a7960911a0 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.828036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 703/1412] 10.222.0.48 () {54 vars in 918 bytes} [Mon May 30 12:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:04.833035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8a50-1df7-4459-ab43-de4a8d3e47a5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:04.833325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8a50-1df7-4459-ab43-de4a8d3e47a5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:04.833606 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8a50-1df7-4459-ab43-de4a8d3e47a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:04.851049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-a2cc8a50-1df7-4459-ab43-de4a8d3e47a5 None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:04.858257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a2cc8a50-1df7-4459-ab43-de4a8d3e47a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:04.861158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 710/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Mon May 30 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:07.539465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f7e9a-a61c-4214-96b9-6aa22c753c25 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:07.540033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f7e9a-a61c-4214-96b9-6aa22c753c25 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:07.540033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f7e9a-a61c-4214-96b9-6aa22c753c25 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:07.541394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:07.546868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42611a7f-074c-44d6-9979-f9b21c431028 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:07.547289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42611a7f-074c-44d6-9979-f9b21c431028 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:07.547441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42611a7f-074c-44d6-9979-f9b21c431028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:07.565166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-42611a7f-074c-44d6-9979-f9b21c431028 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:07.566408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-42611a7f-074c-44d6-9979-f9b21c431028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:07.574123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:07.616894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f7e9a-a61c-4214-96b9-6aa22c753c25 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:07.630946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f7e9a-a61c-4214-96b9-6aa22c753c25 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:07.636480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2e99f-b4f4-4254-891d-dc369ed12f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:07.637112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e99f-b4f4-4254-891d-dc369ed12f86 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:07.637398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e99f-b4f4-4254-891d-dc369ed12f86 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:07.637678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e99f-b4f4-4254-891d-dc369ed12f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:07.646539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e99f-b4f4-4254-891d-dc369ed12f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:07.648140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e99f-b4f4-4254-891d-dc369ed12f86 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:07.658513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 705/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:08.634880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99193a0-8e15-44d1-8268-1928071591cf None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:08.635442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99193a0-8e15-44d1-8268-1928071591cf None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:08.635442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99193a0-8e15-44d1-8268-1928071591cf None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:08.636826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:08.642557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41a63-3e0a-4dc9-944a-40f4bb66d1c3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:08.643061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41a63-3e0a-4dc9-944a-40f4bb66d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:08.643598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41a63-3e0a-4dc9-944a-40f4bb66d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:08.662974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cce41a63-3e0a-4dc9-944a-40f4bb66d1c3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:08.664163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cce41a63-3e0a-4dc9-944a-40f4bb66d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:08.672129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:08.846988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99193a0-8e15-44d1-8268-1928071591cf None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:08.861085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99193a0-8e15-44d1-8268-1928071591cf None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:08.866591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd4899-476e-4ef2-a762-44fc0799a2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:08.867225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd4899-476e-4ef2-a762-44fc0799a2cd service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:08.867507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd4899-476e-4ef2-a762-44fc0799a2cd service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:08.867810 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd4899-476e-4ef2-a762-44fc0799a2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:08.876362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd4899-476e-4ef2-a762-44fc0799a2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:08.877938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd4899-476e-4ef2-a762-44fc0799a2cd service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:08.887081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 713/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:09.816730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c895f22-8fd5-43bf-93b1-703c502a8891 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:09.817272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c895f22-8fd5-43bf-93b1-703c502a8891 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:09.817272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c895f22-8fd5-43bf-93b1-703c502a8891 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:09.818666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:09.823457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b767f2-8172-4ea4-80e2-050041b26d78 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:09.823889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b767f2-8172-4ea4-80e2-050041b26d78 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:09.824005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b767f2-8172-4ea4-80e2-050041b26d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:09.841826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d2b767f2-8172-4ea4-80e2-050041b26d78 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:09.843034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d2b767f2-8172-4ea4-80e2-050041b26d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:09.851270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:09.997750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c895f22-8fd5-43bf-93b1-703c502a8891 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:10.011621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c895f22-8fd5-43bf-93b1-703c502a8891 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:10.017521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148fe5b-421f-4306-aece-ade2d3affd22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:10.018159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fe5b-421f-4306-aece-ade2d3affd22 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:10.018435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fe5b-421f-4306-aece-ade2d3affd22 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:10.018715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fe5b-421f-4306-aece-ade2d3affd22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:10.027163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148fe5b-421f-4306-aece-ade2d3affd22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:10.028743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148fe5b-421f-4306-aece-ade2d3affd22 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:10.038747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 708/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:10.939963 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964b42-e974-40cf-9279-090ccf472df0 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:10.940524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964b42-e974-40cf-9279-090ccf472df0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:10.940524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964b42-e974-40cf-9279-090ccf472df0 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:10.941947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:10.947001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65283c1-8c67-4bb9-b892-c44b84e04c1e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:10.947412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65283c1-8c67-4bb9-b892-c44b84e04c1e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:10.947551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65283c1-8c67-4bb9-b892-c44b84e04c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:10.965752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c65283c1-8c67-4bb9-b892-c44b84e04c1e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:10.966993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c65283c1-8c67-4bb9-b892-c44b84e04c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:10.974719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:11.122090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964b42-e974-40cf-9279-090ccf472df0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:11.136710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964b42-e974-40cf-9279-090ccf472df0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:11.142599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dbbff-8f07-4ffb-a73d-31793e67039f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:11.143237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dbbff-8f07-4ffb-a73d-31793e67039f service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:11.143532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dbbff-8f07-4ffb-a73d-31793e67039f service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:11.143804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dbbff-8f07-4ffb-a73d-31793e67039f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:11.151902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dbbff-8f07-4ffb-a73d-31793e67039f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:11.153491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dbbff-8f07-4ffb-a73d-31793e67039f service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:11.162738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 716/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:12.059304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe4a4-112e-4854-b559-ea5b0124ce5a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:12.059838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe4a4-112e-4854-b559-ea5b0124ce5a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:12.059966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffe4a4-112e-4854-b559-ea5b0124ce5a None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:12.061240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:12.066404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501db0-1ca6-4bd4-86aa-4e8e2409278c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:12.066840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501db0-1ca6-4bd4-86aa-4e8e2409278c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:12.066976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501db0-1ca6-4bd4-86aa-4e8e2409278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:12.084991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-05501db0-1ca6-4bd4-86aa-4e8e2409278c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:12.086207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-05501db0-1ca6-4bd4-86aa-4e8e2409278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:12.093759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:12.241390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffe4a4-112e-4854-b559-ea5b0124ce5a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:12.256046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffe4a4-112e-4854-b559-ea5b0124ce5a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:12.261447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b4735-d60f-4550-a2c6-a8620f13c4ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:12.262126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4735-d60f-4550-a2c6-a8620f13c4ae service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:12.262415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4735-d60f-4550-a2c6-a8620f13c4ae service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:12.262693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4735-d60f-4550-a2c6-a8620f13c4ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:12.271328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b4735-d60f-4550-a2c6-a8620f13c4ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:12.272930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b4735-d60f-4550-a2c6-a8620f13c4ae service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:12.283463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 711/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:13.202517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe8d4-281c-4326-a3ff-da26eeb0c8e3 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:13.203077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe8d4-281c-4326-a3ff-da26eeb0c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:13.203077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe8d4-281c-4326-a3ff-da26eeb0c8e3 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:13.205008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:13.210003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713172c-4732-4129-a309-444f536e2a61 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:13.210420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713172c-4732-4129-a309-444f536e2a61 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:13.210583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713172c-4732-4129-a309-444f536e2a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:13.228341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1713172c-4732-4129-a309-444f536e2a61 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:13.229511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1713172c-4732-4129-a309-444f536e2a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:13.237369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:13.385379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe8d4-281c-4326-a3ff-da26eeb0c8e3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:13.399885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe8d4-281c-4326-a3ff-da26eeb0c8e3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:13.405145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a52d9a-69c4-4406-b5d8-2168ed062f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:13.405775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a52d9a-69c4-4406-b5d8-2168ed062f6f service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:13.406093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a52d9a-69c4-4406-b5d8-2168ed062f6f service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:13.406403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a52d9a-69c4-4406-b5d8-2168ed062f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:13.414332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a52d9a-69c4-4406-b5d8-2168ed062f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:13.415912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a52d9a-69c4-4406-b5d8-2168ed062f6f service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:13.425610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 719/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:14.330023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6f3d7-7d1b-47f6-9b26-eec78fa80948 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:14.330614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6f3d7-7d1b-47f6-9b26-eec78fa80948 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:14.330614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6f3d7-7d1b-47f6-9b26-eec78fa80948 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:14.331975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:14.336922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164196a-e68c-4c2d-9b10-aeb80e652959 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:14.337299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164196a-e68c-4c2d-9b10-aeb80e652959 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:14.337492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164196a-e68c-4c2d-9b10-aeb80e652959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:14.355134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f164196a-e68c-4c2d-9b10-aeb80e652959 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:14.356337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f164196a-e68c-4c2d-9b10-aeb80e652959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:14.364538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:14.513424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6f3d7-7d1b-47f6-9b26-eec78fa80948 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:14.528136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6f3d7-7d1b-47f6-9b26-eec78fa80948 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:14.534125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9219c0-7c8d-42b7-9da0-a6cab1a7e456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:14.534765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9219c0-7c8d-42b7-9da0-a6cab1a7e456 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:14.535050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9219c0-7c8d-42b7-9da0-a6cab1a7e456 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:14.535328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9219c0-7c8d-42b7-9da0-a6cab1a7e456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:14.543757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9219c0-7c8d-42b7-9da0-a6cab1a7e456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:14.545350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9219c0-7c8d-42b7-9da0-a6cab1a7e456 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:14.555677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 714/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:15.479688 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277795-9569-4be9-a434-9734bed3c6d7 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:15.480252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277795-9569-4be9-a434-9734bed3c6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:15.480354 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c277795-9569-4be9-a434-9734bed3c6d7 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:15.481675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:08:15.487072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664a079-d284-4a6f-a70d-6f81452324dc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:15.487498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664a079-d284-4a6f-a70d-6f81452324dc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:15.487628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664a079-d284-4a6f-a70d-6f81452324dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:15.505062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3664a079-d284-4a6f-a70d-6f81452324dc None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:15.506294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3664a079-d284-4a6f-a70d-6f81452324dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:15.513793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:15.663492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c277795-9569-4be9-a434-9734bed3c6d7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:15.678095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c277795-9569-4be9-a434-9734bed3c6d7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:15.683602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7998dcf-dc49-46e9-b1f1-511fa30412b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:15.684241 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998dcf-dc49-46e9-b1f1-511fa30412b1 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:15.684531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998dcf-dc49-46e9-b1f1-511fa30412b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:15.684820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998dcf-dc49-46e9-b1f1-511fa30412b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:15.692803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7998dcf-dc49-46e9-b1f1-511fa30412b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:15.694433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7998dcf-dc49-46e9-b1f1-511fa30412b1 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:15.704532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 722/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:16.643620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c823c-97a1-4235-8fc6-c1d0539e83c4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:16.644198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c823c-97a1-4235-8fc6-c1d0539e83c4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:16.644198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c823c-97a1-4235-8fc6-c1d0539e83c4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:16.645546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:16.650405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c662e4c-ca68-4986-9a90-47789f294070 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:16.650830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c662e4c-ca68-4986-9a90-47789f294070 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:16.650971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c662e4c-ca68-4986-9a90-47789f294070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:16.668515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0c662e4c-ca68-4986-9a90-47789f294070 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:16.669725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0c662e4c-ca68-4986-9a90-47789f294070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:16.677827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:16.831188 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c823c-97a1-4235-8fc6-c1d0539e83c4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:16.846351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c823c-97a1-4235-8fc6-c1d0539e83c4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:16.851695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8401710-1e21-4283-a399-e243febe5956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:16.852328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401710-1e21-4283-a399-e243febe5956 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:16.852614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401710-1e21-4283-a399-e243febe5956 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:16.852892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401710-1e21-4283-a399-e243febe5956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:16.861065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8401710-1e21-4283-a399-e243febe5956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:16.862700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8401710-1e21-4283-a399-e243febe5956 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:16.872002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 717/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:18.975733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc1a0-84a7-41c8-85e2-e6dafb3e9cc3 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:18.976269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc1a0-84a7-41c8-85e2-e6dafb3e9cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:18.976269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc1a0-84a7-41c8-85e2-e6dafb3e9cc3 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:18.977676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:18.983240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594ec0-b3a5-48f6-82ce-dd0d41474bc8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:18.983705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594ec0-b3a5-48f6-82ce-dd0d41474bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:18.983835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594ec0-b3a5-48f6-82ce-dd0d41474bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:19.002260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ac594ec0-b3a5-48f6-82ce-dd0d41474bc8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:19.003381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ac594ec0-b3a5-48f6-82ce-dd0d41474bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:19.011056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:08:19.051205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fc1a0-84a7-41c8-85e2-e6dafb3e9cc3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:19.062195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fc1a0-84a7-41c8-85e2-e6dafb3e9cc3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:19.065651 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bf327-f270-45d8-b7cb-737c3af7fd07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:19.066325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bf327-f270-45d8-b7cb-737c3af7fd07 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:19.066613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bf327-f270-45d8-b7cb-737c3af7fd07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:19.066892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bf327-f270-45d8-b7cb-737c3af7fd07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:19.075582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bf327-f270-45d8-b7cb-737c3af7fd07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:19.077021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bf327-f270-45d8-b7cb-737c3af7fd07 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:19.086400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 725/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:21.426769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c96d2-ea37-4f07-8c31-9661b38b5843 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:21.427331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c96d2-ea37-4f07-8c31-9661b38b5843 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:21.427331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c96d2-ea37-4f07-8c31-9661b38b5843 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:21.428927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:21.434109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856bf53-0777-437b-96e7-3fa00d8b95f7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:21.434491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856bf53-0777-437b-96e7-3fa00d8b95f7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:21.434678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856bf53-0777-437b-96e7-3fa00d8b95f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:21.452435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f856bf53-0777-437b-96e7-3fa00d8b95f7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:21.454293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f856bf53-0777-437b-96e7-3fa00d8b95f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:21.461891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:21.498245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c96d2-ea37-4f07-8c31-9661b38b5843 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:21.509118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c96d2-ea37-4f07-8c31-9661b38b5843 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:21.512556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdc320-368d-44f7-9085-65991c238f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:21.513174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc320-368d-44f7-9085-65991c238f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:21.513458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc320-368d-44f7-9085-65991c238f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:21.513736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc320-368d-44f7-9085-65991c238f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:21.522884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdc320-368d-44f7-9085-65991c238f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:21.524316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdc320-368d-44f7-9085-65991c238f59 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:21.533405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 720/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:24.187987 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92502-3ad0-4493-88eb-b6d5f6d8edcc None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:24.188631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92502-3ad0-4493-88eb-b6d5f6d8edcc None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:24.188631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92502-3ad0-4493-88eb-b6d5f6d8edcc None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:24.189996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:24.195389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0cd7-0e0e-47e6-bdb1-db80b3640cdb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:24.195876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0cd7-0e0e-47e6-bdb1-db80b3640cdb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:24.195986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf0cd7-0e0e-47e6-bdb1-db80b3640cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:24.213831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-aaaf0cd7-0e0e-47e6-bdb1-db80b3640cdb None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:24.215041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aaaf0cd7-0e0e-47e6-bdb1-db80b3640cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:24.223376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:24.260457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc92502-3ad0-4493-88eb-b6d5f6d8edcc None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:24.271634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc92502-3ad0-4493-88eb-b6d5f6d8edcc None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:24.275273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfa589-bf0f-4e40-908d-56097e1ef682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:24.275942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa589-bf0f-4e40-908d-56097e1ef682 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:24.276231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa589-bf0f-4e40-908d-56097e1ef682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:24.276511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa589-bf0f-4e40-908d-56097e1ef682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:24.286630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfa589-bf0f-4e40-908d-56097e1ef682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:24.288065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfa589-bf0f-4e40-908d-56097e1ef682 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:24.297379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 728/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:26.630411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1100fb1-7c7a-4df0-9ca4-e737440629b3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.630988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1100fb1-7c7a-4df0-9ca4-e737440629b3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.630988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1100fb1-7c7a-4df0-9ca4-e737440629b3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.632358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:26.637739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948f5b-8cdb-48a5-8f68-9ed7c23558d2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.638197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948f5b-8cdb-48a5-8f68-9ed7c23558d2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.638333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948f5b-8cdb-48a5-8f68-9ed7c23558d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.656164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-23948f5b-8cdb-48a5-8f68-9ed7c23558d2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:26.657342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-23948f5b-8cdb-48a5-8f68-9ed7c23558d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:26.664913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:26.704051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1100fb1-7c7a-4df0-9ca4-e737440629b3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:26.714645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1100fb1-7c7a-4df0-9ca4-e737440629b3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:26.718177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e1cda-73a8-4a83-ae91-153b0c3c3b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:26.718811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e1cda-73a8-4a83-ae91-153b0c3c3b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:26.719097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e1cda-73a8-4a83-ae91-153b0c3c3b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:26.719374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e1cda-73a8-4a83-ae91-153b0c3c3b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:26.728451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e1cda-73a8-4a83-ae91-153b0c3c3b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:26.730123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e1cda-73a8-4a83-ae91-153b0c3c3b4d service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:26.739729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 723/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:29.024630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e589e-15ca-49d3-9ce8-6f40c9d45c47 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:29.025171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e589e-15ca-49d3-9ce8-6f40c9d45c47 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:29.025171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e589e-15ca-49d3-9ce8-6f40c9d45c47 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:29.026548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:29.032438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501799c2-3e30-4727-9103-1b7d9f94ddcb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:29.032849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501799c2-3e30-4727-9103-1b7d9f94ddcb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:29.033013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501799c2-3e30-4727-9103-1b7d9f94ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:29.050941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-501799c2-3e30-4727-9103-1b7d9f94ddcb None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:29.052135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-501799c2-3e30-4727-9103-1b7d9f94ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:29.060137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:29.098486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e589e-15ca-49d3-9ce8-6f40c9d45c47 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:29.109640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e589e-15ca-49d3-9ce8-6f40c9d45c47 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:29.113159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b63e7e-879e-46b6-a4a8-87d28cf27b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:29.113786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b63e7e-879e-46b6-a4a8-87d28cf27b14 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:29.114115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b63e7e-879e-46b6-a4a8-87d28cf27b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:29.114395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b63e7e-879e-46b6-a4a8-87d28cf27b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:29.123138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b63e7e-879e-46b6-a4a8-87d28cf27b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:29.124563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b63e7e-879e-46b6-a4a8-87d28cf27b14 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:29.134192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 731/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:31.436520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7e834-04d8-4ac9-a9a2-784036f0ab10 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:31.437084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7e834-04d8-4ac9-a9a2-784036f0ab10 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:31.437202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7e834-04d8-4ac9-a9a2-784036f0ab10 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:31.438563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:31.443789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e14b56-7a57-4e31-b695-7eb7e58cca6b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:31.444230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e14b56-7a57-4e31-b695-7eb7e58cca6b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:31.444343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e14b56-7a57-4e31-b695-7eb7e58cca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:31.462121 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c5e14b56-7a57-4e31-b695-7eb7e58cca6b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:31.463307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c5e14b56-7a57-4e31-b695-7eb7e58cca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:31.471571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:31.508286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7e834-04d8-4ac9-a9a2-784036f0ab10 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:31.519300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7e834-04d8-4ac9-a9a2-784036f0ab10 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:31.522812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615048-1cf3-4d12-86aa-bbe54df190a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:31.523436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615048-1cf3-4d12-86aa-bbe54df190a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:31.523724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615048-1cf3-4d12-86aa-bbe54df190a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:31.524005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615048-1cf3-4d12-86aa-bbe54df190a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:31.533370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f615048-1cf3-4d12-86aa-bbe54df190a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:31.534833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f615048-1cf3-4d12-86aa-bbe54df190a5 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:31.543990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 726/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:33.825740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b4d6-642e-43db-b480-d2b0d6c68001 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:33.826289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b4d6-642e-43db-b480-d2b0d6c68001 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:33.826405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b4d6-642e-43db-b480-d2b0d6c68001 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:33.828232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:33.833654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47040d6-d39a-4ec0-873e-7e3c09339cb1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:33.834106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47040d6-d39a-4ec0-873e-7e3c09339cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:33.834285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47040d6-d39a-4ec0-873e-7e3c09339cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:33.840429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=70 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:33.852728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c47040d6-d39a-4ec0-873e-7e3c09339cb1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:33.853917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c47040d6-d39a-4ec0-873e-7e3c09339cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:33.861610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:33.898303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6b4d6-642e-43db-b480-d2b0d6c68001 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:33.903550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=73 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:33.909707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6b4d6-642e-43db-b480-d2b0d6c68001 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:33.913111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740aab-2e5a-4e5c-8b43-b7b65a1a9c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:33.913733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740aab-2e5a-4e5c-8b43-b7b65a1a9c31 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:33.917560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740aab-2e5a-4e5c-8b43-b7b65a1a9c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:33.917560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740aab-2e5a-4e5c-8b43-b7b65a1a9c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:33.922957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0740aab-2e5a-4e5c-8b43-b7b65a1a9c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:33.924377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0740aab-2e5a-4e5c-8b43-b7b65a1a9c31 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:33.934022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 734/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:36.197487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205066b-71ce-4bf6-89ae-6f4ba6572603 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:36.198099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205066b-71ce-4bf6-89ae-6f4ba6572603 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:36.198099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205066b-71ce-4bf6-89ae-6f4ba6572603 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:36.199447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:36.204768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b891d55-d741-4e6a-b6c5-80f97bc7e3a7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:36.205197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b891d55-d741-4e6a-b6c5-80f97bc7e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:36.205317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b891d55-d741-4e6a-b6c5-80f97bc7e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:36.223498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2b891d55-d741-4e6a-b6c5-80f97bc7e3a7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:36.224697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2b891d55-d741-4e6a-b6c5-80f97bc7e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:36.232230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:36.270012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205066b-71ce-4bf6-89ae-6f4ba6572603 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:36.281019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205066b-71ce-4bf6-89ae-6f4ba6572603 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:36.284516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c2c88-b1c0-4880-9a1d-9053a51df597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:36.285146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c2c88-b1c0-4880-9a1d-9053a51df597 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:36.285437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c2c88-b1c0-4880-9a1d-9053a51df597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:36.285719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c2c88-b1c0-4880-9a1d-9053a51df597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:36.294582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c2c88-b1c0-4880-9a1d-9053a51df597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:36.296682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c2c88-b1c0-4880-9a1d-9053a51df597 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:36.306345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 729/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:38.550317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e002-f101-4f87-a4f2-5d1223b67501 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:38.550880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e002-f101-4f87-a4f2-5d1223b67501 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:38.550880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7e002-f101-4f87-a4f2-5d1223b67501 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:38.552267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:38.557716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841b9f-b3bb-4d12-9d99-692d7fd7ac4c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:38.558148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841b9f-b3bb-4d12-9d99-692d7fd7ac4c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:38.558335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841b9f-b3bb-4d12-9d99-692d7fd7ac4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:38.576110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b1841b9f-b3bb-4d12-9d99-692d7fd7ac4c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:38.577946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b1841b9f-b3bb-4d12-9d99-692d7fd7ac4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:38.585607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:38.621199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7e002-f101-4f87-a4f2-5d1223b67501 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:38.632280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7e002-f101-4f87-a4f2-5d1223b67501 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:38.635779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c443-e922-4d61-b0ea-08171c7cf7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:38.636409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c443-e922-4d61-b0ea-08171c7cf7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:38.636700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c443-e922-4d61-b0ea-08171c7cf7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:38.636981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c443-e922-4d61-b0ea-08171c7cf7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:38.646389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c443-e922-4d61-b0ea-08171c7cf7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:38.647824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c443-e922-4d61-b0ea-08171c7cf7d8 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:38.657037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 737/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:40.895364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8850b-0a4a-489e-9693-b4486dcac332 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:40.895927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8850b-0a4a-489e-9693-b4486dcac332 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:40.895927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8850b-0a4a-489e-9693-b4486dcac332 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:40.897280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:08:40.902665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0c15-2760-4cd1-b72e-53b7bbb40af2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:40.903100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0c15-2760-4cd1-b72e-53b7bbb40af2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:40.903264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0c15-2760-4cd1-b72e-53b7bbb40af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:40.920582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-056a0c15-2760-4cd1-b72e-53b7bbb40af2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:08:40.921778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-056a0c15-2760-4cd1-b72e-53b7bbb40af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:08:40.929737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:08:40.966369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8850b-0a4a-489e-9693-b4486dcac332 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:08:40.976848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8850b-0a4a-489e-9693-b4486dcac332 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:08:40.980320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e976c-ee97-48d0-a8fb-56555bb0c808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:08:40.980946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e976c-ee97-48d0-a8fb-56555bb0c808 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:08:40.981228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e976c-ee97-48d0-a8fb-56555bb0c808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:08:40.981503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e976c-ee97-48d0-a8fb-56555bb0c808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:08:40.990271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e976c-ee97-48d0-a8fb-56555bb0c808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:08:40.991708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e976c-ee97-48d0-a8fb-56555bb0c808 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:08:41.001374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 732/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:08:50.915552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=17 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:50.996749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=17 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:12.844945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e1ab5-a7b9-4678-b45b-f4327547b0ea None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:12.845523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e1ab5-a7b9-4678-b45b-f4327547b0ea None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:12.845629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e1ab5-a7b9-4678-b45b-f4327547b0ea None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:12.847043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 739/1471] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:12.852480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29f6f-345d-4d11-a3de-c1514b6cd4dd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:12.852931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29f6f-345d-4d11-a3de-c1514b6cd4dd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:12.853038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29f6f-345d-4d11-a3de-c1514b6cd4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:12.870347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a6c29f6f-345d-4d11-a3de-c1514b6cd4dd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:12.871533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a6c29f6f-345d-4d11-a3de-c1514b6cd4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:12.879201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 733/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:12.926014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a7df-3fe9-4ef7-baff-c71bd993e535 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:12.926312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a7df-3fe9-4ef7-baff-c71bd993e535 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:12.926852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a7df-3fe9-4ef7-baff-c71bd993e535 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:12.928247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 740/1473] 10.222.0.48 () {54 vars in 962 bytes} [Mon May 30 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:12.933038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d02d6-c60f-4f30-8880-3562a55e2ed1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:12.933334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d02d6-c60f-4f30-8880-3562a55e2ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:12.933617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d02d6-c60f-4f30-8880-3562a55e2ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:12.952301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bc3d02d6-c60f-4f30-8880-3562a55e2ed1 None None] MFA Rules not processed for user `ca08d82f02a24e0088aceff2b6ba307d`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:12.953470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bc3d02d6-c60f-4f30-8880-3562a55e2ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:12.959804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 734/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Mon May 30 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:12.967402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a7df-3fe9-4ef7-baff-c71bd993e535 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:12.977878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a7df-3fe9-4ef7-baff-c71bd993e535 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:12.981392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996edd2-31be-4618-a8af-87c7987b20cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca08d82f02a24e0088aceff2b6ba307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:12.982041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996edd2-31be-4618-a8af-87c7987b20cd service glance] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:12.982332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996edd2-31be-4618-a8af-87c7987b20cd service glance] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:12.982611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996edd2-31be-4618-a8af-87c7987b20cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:12.991346 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996edd2-31be-4618-a8af-87c7987b20cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:12.992779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996edd2-31be-4618-a8af-87c7987b20cd service glance] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:13.002035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 741/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:15.347710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dca7f-45ed-46f6-b436-0b084305d58a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:15.348249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dca7f-45ed-46f6-b436-0b084305d58a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:15.348394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dca7f-45ed-46f6-b436-0b084305d58a None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:15.349643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 735/1476] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:09:15.354932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53483-c5cb-494f-b92c-45ed94f1f53c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:15.355361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53483-c5cb-494f-b92c-45ed94f1f53c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:15.355499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53483-c5cb-494f-b92c-45ed94f1f53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:15.373306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-3aa53483-c5cb-494f-b92c-45ed94f1f53c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:15.374536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3aa53483-c5cb-494f-b92c-45ed94f1f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:15.382146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 742/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:15.406244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dca7f-45ed-46f6-b436-0b084305d58a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:15.418534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dca7f-45ed-46f6-b436-0b084305d58a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:15.423815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80350b13-0dc1-4aca-a497-ebda067efd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:15.424091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350b13-0dc1-4aca-a497-ebda067efd19 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:15.424376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350b13-0dc1-4aca-a497-ebda067efd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:15.424676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80350b13-0dc1-4aca-a497-ebda067efd19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:15.425407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80350b13-0dc1-4aca-a497-ebda067efd19 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:15.427466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-80350b13-0dc1-4aca-a497-ebda067efd19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:09:15.427466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: warnings.warn(msg) May 30 12:09:15.427466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: May 30 12:09:15.428596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80350b13-0dc1-4aca-a497-ebda067efd19 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:15.447706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 736/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 30 12:09:15 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:09:17.682869 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8a44-dd3d-4159-a2e3-05150d3bf63a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:17.683437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8a44-dd3d-4159-a2e3-05150d3bf63a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:17.683437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8a44-dd3d-4159-a2e3-05150d3bf63a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:17.685343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 743/1479] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:17.690867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524346a8-61d9-47cd-9f70-ada5ac5ef6bd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:17.691299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524346a8-61d9-47cd-9f70-ada5ac5ef6bd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:17.691469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524346a8-61d9-47cd-9f70-ada5ac5ef6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:17.709863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-524346a8-61d9-47cd-9f70-ada5ac5ef6bd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:17.711092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-524346a8-61d9-47cd-9f70-ada5ac5ef6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:17.718847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 737/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:17.763282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e8a44-dd3d-4159-a2e3-05150d3bf63a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:17.777534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e8a44-dd3d-4159-a2e3-05150d3bf63a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:17.782942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04a2dd-3cdb-4ece-a031-9a4802e2e117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:17.783575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a2dd-3cdb-4ece-a031-9a4802e2e117 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:17.783861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a2dd-3cdb-4ece-a031-9a4802e2e117 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:17.784138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a2dd-3cdb-4ece-a031-9a4802e2e117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:17.792162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04a2dd-3cdb-4ece-a031-9a4802e2e117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:17.793759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04a2dd-3cdb-4ece-a031-9a4802e2e117 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:17.803292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 744/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:20.189346 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934f5be-95df-404a-aad7-a8327e859f82 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:20.189871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934f5be-95df-404a-aad7-a8327e859f82 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:20.189871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934f5be-95df-404a-aad7-a8327e859f82 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:20.191312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 738/1482] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:20.196739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897163c-bd16-4e8c-bfe2-21d5ea3e5579 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:20.197133 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897163c-bd16-4e8c-bfe2-21d5ea3e5579 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:20.197301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897163c-bd16-4e8c-bfe2-21d5ea3e5579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:20.216240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8897163c-bd16-4e8c-bfe2-21d5ea3e5579 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:20.217421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8897163c-bd16-4e8c-bfe2-21d5ea3e5579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:20.225021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 745/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:20.260320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934f5be-95df-404a-aad7-a8327e859f82 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:20.271523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934f5be-95df-404a-aad7-a8327e859f82 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:20.275120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e099a-d121-411d-a78a-00899f2485f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:20.275750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e099a-d121-411d-a78a-00899f2485f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:20.276032 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e099a-d121-411d-a78a-00899f2485f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:20.276306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e099a-d121-411d-a78a-00899f2485f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:20.285757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e099a-d121-411d-a78a-00899f2485f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:20.287226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e099a-d121-411d-a78a-00899f2485f0 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:20.296352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 739/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:22.543577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d06f0-9d1e-4723-88d0-2b5b27a9d5ed None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:22.544168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d06f0-9d1e-4723-88d0-2b5b27a9d5ed None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:22.544168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d06f0-9d1e-4723-88d0-2b5b27a9d5ed None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:22.545582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 746/1485] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:22.550887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675f73-6b8b-482f-bdb1-deefd1632d40 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:22.551531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675f73-6b8b-482f-bdb1-deefd1632d40 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:22.551700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675f73-6b8b-482f-bdb1-deefd1632d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:22.568829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2f675f73-6b8b-482f-bdb1-deefd1632d40 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:22.570038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2f675f73-6b8b-482f-bdb1-deefd1632d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:22.578173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 740/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:22.615064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d06f0-9d1e-4723-88d0-2b5b27a9d5ed None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:22.625541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d06f0-9d1e-4723-88d0-2b5b27a9d5ed None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:22.629007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9cd55-79ba-4466-81b5-46a25a23df48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:22.629655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cd55-79ba-4466-81b5-46a25a23df48 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:22.629943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cd55-79ba-4466-81b5-46a25a23df48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:22.630323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cd55-79ba-4466-81b5-46a25a23df48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:22.639574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9cd55-79ba-4466-81b5-46a25a23df48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:22.641008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9cd55-79ba-4466-81b5-46a25a23df48 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:22.650277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 747/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:24.988410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9f8e-ba0c-4700-9027-8dd1258d5eec None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:24.989033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9f8e-ba0c-4700-9027-8dd1258d5eec None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:24.989033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9f8e-ba0c-4700-9027-8dd1258d5eec None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:24.990363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 741/1488] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:24.995648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bec238-50cb-4ec2-98cd-fdc9ddf6b55f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:24.996101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bec238-50cb-4ec2-98cd-fdc9ddf6b55f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:24.996210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bec238-50cb-4ec2-98cd-fdc9ddf6b55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:25.014118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-01bec238-50cb-4ec2-98cd-fdc9ddf6b55f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:25.015248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-01bec238-50cb-4ec2-98cd-fdc9ddf6b55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:25.022862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 748/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:25.064231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab9f8e-ba0c-4700-9027-8dd1258d5eec None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:25.065925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9cab9f8e-ba0c-4700-9027-8dd1258d5eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:25.079448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab9f8e-ba0c-4700-9027-8dd1258d5eec None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:25.083040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9e408-7e0d-4ac6-a704-8869346a7f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:25.083676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9e408-7e0d-4ac6-a704-8869346a7f95 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:25.083966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9e408-7e0d-4ac6-a704-8869346a7f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:25.084248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9e408-7e0d-4ac6-a704-8869346a7f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:25.093096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9e408-7e0d-4ac6-a704-8869346a7f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:25.094580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9e408-7e0d-4ac6-a704-8869346a7f95 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:25.103934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 742/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:27.763963 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9b88-0c86-4859-aac1-97c8d7edebe7 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:27.764459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9b88-0c86-4859-aac1-97c8d7edebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:27.764559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9b88-0c86-4859-aac1-97c8d7edebe7 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:27.765904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 749/1491] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 30 12:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:09:27.771072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb80e52-685d-4f26-bbc3-73d71fd2f419 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:27.771497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb80e52-685d-4f26-bbc3-73d71fd2f419 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:27.771647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb80e52-685d-4f26-bbc3-73d71fd2f419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:27.789352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-aeb80e52-685d-4f26-bbc3-73d71fd2f419 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:09:27.790569 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aeb80e52-685d-4f26-bbc3-73d71fd2f419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:09:27.798869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 743/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 30 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:09:27.837404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba9b88-0c86-4859-aac1-97c8d7edebe7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:09:27.848028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba9b88-0c86-4859-aac1-97c8d7edebe7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:09:27.851569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b0598-31d6-4783-b66e-0f57d254372f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:09:27.852198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0598-31d6-4783-b66e-0f57d254372f service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:09:27.852487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0598-31d6-4783-b66e-0f57d254372f service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:09:27.852766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0598-31d6-4783-b66e-0f57d254372f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:09:27.862182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b0598-31d6-4783-b66e-0f57d254372f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:09:27.863628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b0598-31d6-4783-b66e-0f57d254372f service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:09:27.873468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 750/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:09:37.789602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=33 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:37.868706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=33 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:22.989756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9923-a4f7-4366-83c4-78023f8fbb67 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:22.990372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9923-a4f7-4366-83c4-78023f8fbb67 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:22.990372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab9923-a4f7-4366-83c4-78023f8fbb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.008407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cdab9923-a4f7-4366-83c4-78023f8fbb67 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:11:23.009544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cdab9923-a4f7-4366-83c4-78023f8fbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:23.017636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 744/1494] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:11:23.026467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e633d8-bf46-4276-a239-1969c69a6702 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.026932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e633d8-bf46-4276-a239-1969c69a6702 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.027043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e633d8-bf46-4276-a239-1969c69a6702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.045119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-97e633d8-bf46-4276-a239-1969c69a6702 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:11:23.046342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-97e633d8-bf46-4276-a239-1969c69a6702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:23.054300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 751/1495] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:11:23.058748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab9923-a4f7-4366-83c4-78023f8fbb67 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:23.068295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab9923-a4f7-4366-83c4-78023f8fbb67 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:23.073389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:23.074074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.074365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.074644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.075367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:11:23.075677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:23.076699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:11:23.076699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: warnings.warn(msg) May 30 12:11:23.076699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: May 30 12:11:23.077585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:23.089633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 745/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:11:23.097654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e633d8-bf46-4276-a239-1969c69a6702 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:23.106635 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e633d8-bf46-4276-a239-1969c69a6702 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:23.111148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:23.111793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.112083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.112365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.113049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:23.114817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING py.warnings [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:11:23.114817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: warnings.warn(msg) May 30 12:11:23.114817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: May 30 12:11:23.116008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:23.220981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 752/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:11:23 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:11:23.225110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:23.235178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b5b9d-c9d2-4d8b-b6a9-ff75e329dccd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:23.290164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:23.290765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.291149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.291439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.292129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:23.293153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:11:23.293153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: warnings.warn(msg) May 30 12:11:23.293153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: May 30 12:11:23.294432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:23.350744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 746/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:11:23 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:11:23.354769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:23.364957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc362c-db3c-4f89-8dfd-2d92e7467681 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:23.369423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:23.370116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.370407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.370690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.371446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:23.372466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING py.warnings [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:11:23.372466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: warnings.warn(msg) May 30 12:11:23.372466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: May 30 12:11:23.373359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:23.386862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 753/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:11:23.390729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:23.401136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc59ef-5a6c-40ca-8760-e7faa9aa0704 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:23.405604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b7c25-9651-48bf-abd2-11a14a43e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:23.406327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7c25-9651-48bf-abd2-11a14a43e74e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.406608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7c25-9651-48bf-abd2-11a14a43e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.406884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7c25-9651-48bf-abd2-11a14a43e74e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.407600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b7c25-9651-48bf-abd2-11a14a43e74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:23.408603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-2d8b7c25-9651-48bf-abd2-11a14a43e74e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:11:23.408603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: warnings.warn(msg) May 30 12:11:23.408603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: May 30 12:11:23.409484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b7c25-9651-48bf-abd2-11a14a43e74e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:23.422633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 747/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:11:23.426593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:23.436522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498418a-c541-498c-94ca-fe44cb69f146 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:23.440995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9bb3d-0857-4ab6-8451-233ad1a59639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:23.441872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9bb3d-0857-4ab6-8451-233ad1a59639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.442218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9bb3d-0857-4ab6-8451-233ad1a59639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.442542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9bb3d-0857-4ab6-8451-233ad1a59639 admin admin] PATH_INFO: `/v3/projects/e43f4769d9634a11833f3460ea026b8e/users/0e78e70e431944a3912c109627240688/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.457398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9bb3d-0857-4ab6-8451-233ad1a59639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43f4769d9634a11833f3460ea026b8e, user_id=0e78e70e431944a3912c109627240688, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:23.458450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING py.warnings [None req-57a9bb3d-0857-4ab6-8451-233ad1a59639 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:11:23.458450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: warnings.warn(msg) May 30 12:11:23.458450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: May 30 12:11:23.460382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9bb3d-0857-4ab6-8451-233ad1a59639 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:23.631833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 754/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:11:23 2022] PUT /identity/v3/projects/e43f4769d9634a11833f3460ea026b8e/users/0e78e70e431944a3912c109627240688/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:11:23.644638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c75f-5c5f-4b6d-9fd2-9bfc0c8c1ea1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.646465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c75f-5c5f-4b6d-9fd2-9bfc0c8c1ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.646465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c75f-5c5f-4b6d-9fd2-9bfc0c8c1ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.671242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3f61c75f-5c5f-4b6d-9fd2-9bfc0c8c1ea1 None None] MFA Rules not processed for user `0e78e70e431944a3912c109627240688`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:11:23.672731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3f61c75f-5c5f-4b6d-9fd2-9bfc0c8c1ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:23.734378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 748/1502] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:11:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:11:23.748336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d120-021a-4b74-a83d-2e761d08fec7 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.748684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d120-021a-4b74-a83d-2e761d08fec7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.749009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3d120-021a-4b74-a83d-2e761d08fec7 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.751058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 755/1503] 10.222.0.48 () {54 vars in 963 bytes} [Mon May 30 12:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:11:23.755608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c355a3-8aa0-48b4-9350-e442beed739a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.755908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c355a3-8aa0-48b4-9350-e442beed739a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.756190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c355a3-8aa0-48b4-9350-e442beed739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.774600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-30c355a3-8aa0-48b4-9350-e442beed739a None None] MFA Rules not processed for user `a4d11748f14d40628414db49de696fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:11:23.775804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-30c355a3-8aa0-48b4-9350-e442beed739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:23.818556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:23.826751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 749/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Mon May 30 12:11:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:11:23.834417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d120-021a-4b74-a83d-2e761d08fec7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:23.845299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3d120-021a-4b74-a83d-2e761d08fec7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:23.849128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375205e-3dc3-496f-9bea-0feb5d45cc43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:23.849775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375205e-3dc3-496f-9bea-0feb5d45cc43 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.850126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375205e-3dc3-496f-9bea-0feb5d45cc43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.850440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375205e-3dc3-496f-9bea-0feb5d45cc43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.859223 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375205e-3dc3-496f-9bea-0feb5d45cc43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:23.860674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375205e-3dc3-496f-9bea-0feb5d45cc43 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:23.869853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 756/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:11:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:11:23.913242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf158-f2fc-43b0-a493-b40e9535880e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.913542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf158-f2fc-43b0-a493-b40e9535880e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.913826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf158-f2fc-43b0-a493-b40e9535880e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.915664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 750/1506] 10.222.0.48 () {52 vars in 829 bytes} [Mon May 30 12:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:11:23.919307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375205e-3dc3-496f-9bea-0feb5d45cc43 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:23.980380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375205e-3dc3-496f-9bea-0feb5d45cc43 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:23.984847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:23.985722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:23.986066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:23.986406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] PATH_INFO: `/v3/users/0e78e70e431944a3912c109627240688` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:23.987654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e78e70e431944a3912c109627240688)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:23.988695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING py.warnings [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:11:23.988695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: warnings.warn(msg) May 30 12:11:23.988695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: May 30 12:11:23.989891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:24.220910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e78e70e431944a3912c109627240688'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:24.233718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e78e70e431944a3912c109627240688'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:24.234409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e78e70e431944a3912c109627240688'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:24.235124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e78e70e431944a3912c109627240688'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:24.322485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e78e70e431944a3912c109627240688'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:24.339082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:24.347298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 757/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:11:23 2022] DELETE /identity/v3/users/0e78e70e431944a3912c109627240688 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:11:24.351765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a5baa-2b24-4c6e-af13-4902502c2876 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:24.352261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a5baa-2b24-4c6e-af13-4902502c2876 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:24.352368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a5baa-2b24-4c6e-af13-4902502c2876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:24.371202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-330a5baa-2b24-4c6e-af13-4902502c2876 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:11:24.372370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-330a5baa-2b24-4c6e-af13-4902502c2876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:24.430697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 751/1508] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:11:24.440084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:24.441511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:24.499032 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4c1c9-263d-4f93-acd6-bf149b49039f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:24.502655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c650aa7-f6ea-4864-8afc-32eec7777c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:24.503304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c650aa7-f6ea-4864-8afc-32eec7777c73 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:24.503589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c650aa7-f6ea-4864-8afc-32eec7777c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:24.503868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c650aa7-f6ea-4864-8afc-32eec7777c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:24.512560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c650aa7-f6ea-4864-8afc-32eec7777c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:24.514026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c650aa7-f6ea-4864-8afc-32eec7777c73 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:24.523383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 758/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:11:25.010772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a5baa-2b24-4c6e-af13-4902502c2876 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:11:25.012217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-330a5baa-2b24-4c6e-af13-4902502c2876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:11:25.023934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a5baa-2b24-4c6e-af13-4902502c2876 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:11:25.028653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:11:25.029514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:11:25.029896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:11:25.030240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] PATH_INFO: `/v3/projects/e43f4769d9634a11833f3460ea026b8e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:11:25.031873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43f4769d9634a11833f3460ea026b8e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:11:25.033140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:11:25.033140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: warnings.warn(msg) May 30 12:11:25.033140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: May 30 12:11:25.034158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:11:25.161705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43f4769d9634a11833f3460ea026b8e', 'request_id': 'req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:25.260239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43f4769d9634a11833f3460ea026b8e', 'request_id': 'req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:25.273565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43f4769d9634a11833f3460ea026b8e', 'request_id': 'req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:25.284246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] The token cache is being invalidate because project e43f4769d9634a11833f3460ea026b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:11:25.284540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:25.285269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9c0dfd0e-5b7c-4261-ada6-b16b5a43bc39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:11:25.286827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 752/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:11:25 2022] DELETE /identity/v3/projects/e43f4769d9634a11833f3460ea026b8e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:11:34.519106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:35.281247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:08.795047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b571ff-e846-48f3-8db2-54c66ab73f1b None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:08.795537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b571ff-e846-48f3-8db2-54c66ab73f1b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:08.795645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b571ff-e846-48f3-8db2-54c66ab73f1b None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:08.797146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:13:08.801846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6d518-a922-482d-a411-e1266bc693b5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:08.802297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6d518-a922-482d-a411-e1266bc693b5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:08.802423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6d518-a922-482d-a411-e1266bc693b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:08.820430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e8d6d518-a922-482d-a411-e1266bc693b5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:08.821607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e8d6d518-a922-482d-a411-e1266bc693b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:08.877354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:09.045008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b571ff-e846-48f3-8db2-54c66ab73f1b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:09.046700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b8b571ff-e846-48f3-8db2-54c66ab73f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:09.121895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b571ff-e846-48f3-8db2-54c66ab73f1b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:09.127233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57a3fb-31c6-4362-a7eb-7f6c91e44c1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:09.127875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57a3fb-31c6-4362-a7eb-7f6c91e44c1e service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:09.128161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57a3fb-31c6-4362-a7eb-7f6c91e44c1e service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:09.128435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57a3fb-31c6-4362-a7eb-7f6c91e44c1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:09.137335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57a3fb-31c6-4362-a7eb-7f6c91e44c1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:09.138958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57a3fb-31c6-4362-a7eb-7f6c91e44c1e service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:09.148212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 760/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:10.014641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539cef-2362-4c23-9caf-4a8edff96348 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:10.015158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539cef-2362-4c23-9caf-4a8edff96348 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:10.015158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539cef-2362-4c23-9caf-4a8edff96348 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:10.016555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:13:10.021453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77f50-1b7e-4da0-a6ef-121bea62a8dd None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:10.022405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77f50-1b7e-4da0-a6ef-121bea62a8dd None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:10.022557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77f50-1b7e-4da0-a6ef-121bea62a8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:10.044158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-56a77f50-1b7e-4da0-a6ef-121bea62a8dd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:10.045398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-56a77f50-1b7e-4da0-a6ef-121bea62a8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:10.053304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:10.102098 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437150-56cb-4023-a7c4-c78283eb3bda None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:10.102396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437150-56cb-4023-a7c4-c78283eb3bda None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:10.102707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437150-56cb-4023-a7c4-c78283eb3bda None None] PATH_INFO: `/v3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:10.104012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 755/1516] 10.222.0.39 () {54 vars in 925 bytes} [Mon May 30 12:13:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:13:10.110663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083893f-e686-48ff-9418-f699cae441f4 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:10.110958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083893f-e686-48ff-9418-f699cae441f4 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:10.111243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083893f-e686-48ff-9418-f699cae441f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:10.128889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f083893f-e686-48ff-9418-f699cae441f4 None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:10.130096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f083893f-e686-48ff-9418-f699cae441f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:10.198109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 762/1517] 10.222.0.39 () {58 vars in 1015 bytes} [Mon May 30 12:13:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:10.205301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437150-56cb-4023-a7c4-c78283eb3bda None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:10.219598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437150-56cb-4023-a7c4-c78283eb3bda None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:10.225584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2438a1-1391-4afc-9811-e5fb8db2987f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:10.226253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2438a1-1391-4afc-9811-e5fb8db2987f service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:10.226542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2438a1-1391-4afc-9811-e5fb8db2987f service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:10.226819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2438a1-1391-4afc-9811-e5fb8db2987f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:10.234750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2438a1-1391-4afc-9811-e5fb8db2987f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:10.236352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2438a1-1391-4afc-9811-e5fb8db2987f service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:10.245526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 756/1518] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:19.834252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c71f-7f52-4ce5-b3a6-b41f67c6b554 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:19.834769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c71f-7f52-4ce5-b3a6-b41f67c6b554 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:19.834878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8c71f-7f52-4ce5-b3a6-b41f67c6b554 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:19.836240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 763/1519] 10.222.0.48 () {54 vars in 960 bytes} [Mon May 30 12:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:13:19.841249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5862f-4a42-470a-ad23-c780a4b878c1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:19.841656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5862f-4a42-470a-ad23-c780a4b878c1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:19.841816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5862f-4a42-470a-ad23-c780a4b878c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:19.859464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-aeb5862f-4a42-470a-ad23-c780a4b878c1 None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:19.860677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aeb5862f-4a42-470a-ad23-c780a4b878c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:19.869564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 757/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Mon May 30 12:13:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:19.877130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8c71f-7f52-4ce5-b3a6-b41f67c6b554 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:19.890681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8c71f-7f52-4ce5-b3a6-b41f67c6b554 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:19.895553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fd338-463b-4194-8e37-52c210a76743 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:19.896183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd338-463b-4194-8e37-52c210a76743 service placement] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:19.896470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd338-463b-4194-8e37-52c210a76743 service placement] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:19.896781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fd338-463b-4194-8e37-52c210a76743 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:19.914366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fd338-463b-4194-8e37-52c210a76743 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:19.914366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fd338-463b-4194-8e37-52c210a76743 service placement] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:19.915926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 764/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:21.521415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f7ba-e2c9-4182-baed-a97e278882c1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:21.522063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f7ba-e2c9-4182-baed-a97e278882c1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:21.522063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f7ba-e2c9-4182-baed-a97e278882c1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:21.523460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:13:21.528265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13442af-e4a1-4b22-a4eb-7c4c3ac602fd None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:21.528706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13442af-e4a1-4b22-a4eb-7c4c3ac602fd None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:21.528842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13442af-e4a1-4b22-a4eb-7c4c3ac602fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:21.547627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c13442af-e4a1-4b22-a4eb-7c4c3ac602fd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:21.548822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c13442af-e4a1-4b22-a4eb-7c4c3ac602fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:21.557128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:21.707582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146f7ba-e2c9-4182-baed-a97e278882c1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:21.722469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146f7ba-e2c9-4182-baed-a97e278882c1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:21.727764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c19a93-f854-4cf6-ad5a-d0f91b416ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:21.728426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c19a93-f854-4cf6-ad5a-d0f91b416ed5 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:21.728710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c19a93-f854-4cf6-ad5a-d0f91b416ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:21.728988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c19a93-f854-4cf6-ad5a-d0f91b416ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:21.737482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c19a93-f854-4cf6-ad5a-d0f91b416ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:21.739100 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c19a93-f854-4cf6-ad5a-d0f91b416ed5 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:21.749069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 759/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:22.631456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797f019-ad3d-451b-8cfa-dd4c5d349efe None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:22.632023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797f019-ad3d-451b-8cfa-dd4c5d349efe None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:22.632023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797f019-ad3d-451b-8cfa-dd4c5d349efe None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:22.633403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 30 12:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:13:22.638220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbe620-895c-4cf3-93cb-3da969a161c6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:22.638653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbe620-895c-4cf3-93cb-3da969a161c6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:22.638798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbe620-895c-4cf3-93cb-3da969a161c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:22.657410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e6bbe620-895c-4cf3-93cb-3da969a161c6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:22.658643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e6bbe620-895c-4cf3-93cb-3da969a161c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:22.667413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 30 12:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:22.818749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797f019-ad3d-451b-8cfa-dd4c5d349efe None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:22.833577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797f019-ad3d-451b-8cfa-dd4c5d349efe None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:22.839791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ab815-f821-4f30-b361-21e94a5c878d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:22.840460 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab815-f821-4f30-b361-21e94a5c878d service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:22.840768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab815-f821-4f30-b361-21e94a5c878d service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:22.841073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab815-f821-4f30-b361-21e94a5c878d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:22.849562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ab815-f821-4f30-b361-21e94a5c878d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:22.853083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ab815-f821-4f30-b361-21e94a5c878d service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:22.861341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 767/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:27.377087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344163b-e847-4523-a951-68e2d93edaa5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:27.377672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344163b-e847-4523-a951-68e2d93edaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:27.377672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344163b-e847-4523-a951-68e2d93edaa5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:27.379052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:13:27.385169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02298d-f3e6-434b-a114-e8859797fbe1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:27.385586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02298d-f3e6-434b-a114-e8859797fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:27.385741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02298d-f3e6-434b-a114-e8859797fbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:27.403927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-1b02298d-f3e6-434b-a114-e8859797fbe1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:27.405117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1b02298d-f3e6-434b-a114-e8859797fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:27.412783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:27.449970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344163b-e847-4523-a951-68e2d93edaa5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:27.451663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1344163b-e847-4523-a951-68e2d93edaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:27.508690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344163b-e847-4523-a951-68e2d93edaa5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:27.512307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415279e4-c69e-4244-92fc-2f61aea49a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:27.512944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415279e4-c69e-4244-92fc-2f61aea49a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:27.513230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415279e4-c69e-4244-92fc-2f61aea49a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:27.513508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415279e4-c69e-4244-92fc-2f61aea49a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:27.522376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415279e4-c69e-4244-92fc-2f61aea49a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:27.523829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415279e4-c69e-4244-92fc-2f61aea49a2f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:27.533153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 762/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:29.747971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c98f84-716c-466e-bc60-d5871084fffe None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:29.748527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c98f84-716c-466e-bc60-d5871084fffe None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:29.748527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c98f84-716c-466e-bc60-d5871084fffe None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:29.749984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:13:29.755441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71955b-43bf-40f4-8018-120ec530c439 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:29.756379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71955b-43bf-40f4-8018-120ec530c439 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:29.756584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71955b-43bf-40f4-8018-120ec530c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:29.774899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cb71955b-43bf-40f4-8018-120ec530c439 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:29.776090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb71955b-43bf-40f4-8018-120ec530c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:29.783775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:29.820269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c98f84-716c-466e-bc60-d5871084fffe None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:29.822060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-98c98f84-716c-466e-bc60-d5871084fffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:29.834898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c98f84-716c-466e-bc60-d5871084fffe None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:29.838469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701d51-67a0-4546-a55f-4d2c86023e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:29.839104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701d51-67a0-4546-a55f-4d2c86023e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:29.839395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701d51-67a0-4546-a55f-4d2c86023e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:29.839678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701d51-67a0-4546-a55f-4d2c86023e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:29.848920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25701d51-67a0-4546-a55f-4d2c86023e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:29.850879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25701d51-67a0-4546-a55f-4d2c86023e4b service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:29.860137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 770/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:34.018773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8bdc-b952-4712-a27b-b534dfe2c77c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:34.019322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8bdc-b952-4712-a27b-b534dfe2c77c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:34.019322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8bdc-b952-4712-a27b-b534dfe2c77c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:34.020619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:13:34.026475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07d68-c56d-49e2-a6ce-a17e9b7d5fcd None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:34.026936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07d68-c56d-49e2-a6ce-a17e9b7d5fcd None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:34.027076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07d68-c56d-49e2-a6ce-a17e9b7d5fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:34.045611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ecc07d68-c56d-49e2-a6ce-a17e9b7d5fcd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:34.046856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ecc07d68-c56d-49e2-a6ce-a17e9b7d5fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:34.054615 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:34.329911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8bdc-b952-4712-a27b-b534dfe2c77c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:34.331626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aa5f8bdc-b952-4712-a27b-b534dfe2c77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:34.389554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8bdc-b952-4712-a27b-b534dfe2c77c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:34.393224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007af2d-461b-41d4-a0d8-27f7f9b43341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:34.393868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007af2d-461b-41d4-a0d8-27f7f9b43341 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:34.394192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007af2d-461b-41d4-a0d8-27f7f9b43341 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:34.394495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007af2d-461b-41d4-a0d8-27f7f9b43341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:34.403478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007af2d-461b-41d4-a0d8-27f7f9b43341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:34.404932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007af2d-461b-41d4-a0d8-27f7f9b43341 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:34.409946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:34.415414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 765/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:36.896214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44f85-24bd-4f0a-9518-07d214aea291 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:36.902246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44f85-24bd-4f0a-9518-07d214aea291 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:36.902246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44f85-24bd-4f0a-9518-07d214aea291 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:36.902246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 30 12:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:13:36.903552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7b93-43f9-4f7f-b656-e1653e6197d3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:36.903986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7b93-43f9-4f7f-b656-e1653e6197d3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:36.904122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7b93-43f9-4f7f-b656-e1653e6197d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:36.922579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e57b7b93-43f9-4f7f-b656-e1653e6197d3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:13:36.923778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e57b7b93-43f9-4f7f-b656-e1653e6197d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:36.931588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 30 12:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:13:37.202732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c44f85-24bd-4f0a-9518-07d214aea291 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:13:37.204532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-03c44f85-24bd-4f0a-9518-07d214aea291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:13:37.212746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=94 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:37.218753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c44f85-24bd-4f0a-9518-07d214aea291 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:13:37.222429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33beeb2-d46b-4e2d-9dc4-c32967a11a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:13:37.227031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33beeb2-d46b-4e2d-9dc4-c32967a11a52 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:13:37.227031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33beeb2-d46b-4e2d-9dc4-c32967a11a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:13:37.227031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33beeb2-d46b-4e2d-9dc4-c32967a11a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:13:37.232976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33beeb2-d46b-4e2d-9dc4-c32967a11a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:13:37.234499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33beeb2-d46b-4e2d-9dc4-c32967a11a52 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:13:37.243754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 773/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:13:46.917804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:47.247713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:16.030658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a021d-a376-4813-b1fd-e7c2891de97a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.030658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a021d-a376-4813-b1fd-e7c2891de97a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.030658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a021d-a376-4813-b1fd-e7c2891de97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.054220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-017a021d-a376-4813-b1fd-e7c2891de97a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:16.059392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-017a021d-a376-4813-b1fd-e7c2891de97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:16.070500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 767/1540] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:16.079568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be206825-0fd0-418d-b0f3-ea5972b9f53e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.079568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be206825-0fd0-418d-b0f3-ea5972b9f53e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.079568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be206825-0fd0-418d-b0f3-ea5972b9f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.105342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-be206825-0fd0-418d-b0f3-ea5972b9f53e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:16.108177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-be206825-0fd0-418d-b0f3-ea5972b9f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:16.121610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 774/1541] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:16.128265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a021d-a376-4813-b1fd-e7c2891de97a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:16.144725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a021d-a376-4813-b1fd-e7c2891de97a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:16.159972 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d40a6-deb0-4da7-abb6-7a9d1f033ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:16.160667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d40a6-deb0-4da7-abb6-7a9d1f033ced admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.160953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d40a6-deb0-4da7-abb6-7a9d1f033ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.161232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d40a6-deb0-4da7-abb6-7a9d1f033ced admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.162412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d40a6-deb0-4da7-abb6-7a9d1f033ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:16.162763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d40a6-deb0-4da7-abb6-7a9d1f033ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:16.165481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d40a6-deb0-4da7-abb6-7a9d1f033ced admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:16.190545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 768/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:16.192513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be206825-0fd0-418d-b0f3-ea5972b9f53e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:16.213122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769edc-94bf-4af2-b024-656041834ae0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.213507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769edc-94bf-4af2-b024-656041834ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.213693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769edc-94bf-4af2-b024-656041834ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.230636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be206825-0fd0-418d-b0f3-ea5972b9f53e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:16.244793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eefe96-0a6c-4e01-b8bc-83874276b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:16.251493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eefe96-0a6c-4e01-b8bc-83874276b943 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.255447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eefe96-0a6c-4e01-b8bc-83874276b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.255447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eefe96-0a6c-4e01-b8bc-83874276b943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.255447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eefe96-0a6c-4e01-b8bc-83874276b943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:16.262538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eefe96-0a6c-4e01-b8bc-83874276b943 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:16.274716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d4769edc-94bf-4af2-b024-656041834ae0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:16.275974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d4769edc-94bf-4af2-b024-656041834ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:16.297237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 769/1543] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:16.306839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2402-91ae-4de9-8d9a-393f3cd75cec None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.311359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2402-91ae-4de9-8d9a-393f3cd75cec None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.311359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2402-91ae-4de9-8d9a-393f3cd75cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.355386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cf8b2402-91ae-4de9-8d9a-393f3cd75cec None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:16.357110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cf8b2402-91ae-4de9-8d9a-393f3cd75cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:16.367377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 770/1544] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:16.378662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b2402-91ae-4de9-8d9a-393f3cd75cec None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:16.392844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b2402-91ae-4de9-8d9a-393f3cd75cec None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:16.410185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:16.410185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.410185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.410185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.416158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:16.416158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:16.416158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:16.429447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 771/1545] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:16.445761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:16.465874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706cbbc-0015-4950-9eb7-fd8059d3f3fa admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:16.468305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 775/1546] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/projects => generated 369 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:16.473560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eefe96-0a6c-4e01-b8bc-83874276b943 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:16.606067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22fae5-e76c-40ba-888e-d178598fd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:16.606067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22fae5-e76c-40ba-888e-d178598fd267 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.606067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22fae5-e76c-40ba-888e-d178598fd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.606067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22fae5-e76c-40ba-888e-d178598fd267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.606539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22fae5-e76c-40ba-888e-d178598fd267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:16.606840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-2f22fae5-e76c-40ba-888e-d178598fd267 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:15:16.606840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: warnings.warn(msg) May 30 12:15:16.606840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: May 30 12:15:16.607982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22fae5-e76c-40ba-888e-d178598fd267 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:16.673444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eefe96-0a6c-4e01-b8bc-83874276b943 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:16.689274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:16.691034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.691563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.692070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.693547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:16.694867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING py.warnings [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:15:16.694867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: warnings.warn(msg) May 30 12:15:16.694867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: May 30 12:15:16.701988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:16.776164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 772/1547] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/projects => generated 375 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:16.777636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a14f54-b415-4520-ba10-43971d070483 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.778017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a14f54-b415-4520-ba10-43971d070483 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.778338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a14f54-b415-4520-ba10-43971d070483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.821701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a2a14f54-b415-4520-ba10-43971d070483 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:16.824553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a2a14f54-b415-4520-ba10-43971d070483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:16.881991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 776/1548] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/users => generated 285 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:16.883347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:16.906077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a545e-bad5-46f5-96a8-01d11b9d887a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:16.918407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 773/1549] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:16.922006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b026b4e-f613-4ba7-ad6b-8baa874c2341 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.922006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b026b4e-f613-4ba7-ad6b-8baa874c2341 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.922006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b026b4e-f613-4ba7-ad6b-8baa874c2341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.946987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9b026b4e-f613-4ba7-ad6b-8baa874c2341 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:16.948436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9b026b4e-f613-4ba7-ad6b-8baa874c2341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:16.962651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 774/1550] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:16.964689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d101e4-dcb8-44de-91f1-51cbd5261a00 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.965150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d101e4-dcb8-44de-91f1-51cbd5261a00 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.965596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d101e4-dcb8-44de-91f1-51cbd5261a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.985492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c1d101e4-dcb8-44de-91f1-51cbd5261a00 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:16.987636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c1d101e4-dcb8-44de-91f1-51cbd5261a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:16.992254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33229a69-278d-49ea-9459-20986531c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:16.993611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229a69-278d-49ea-9459-20986531c23f admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.994027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229a69-278d-49ea-9459-20986531c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.994503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229a69-278d-49ea-9459-20986531c23f admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:16.995306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33229a69-278d-49ea-9459-20986531c23f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:16.997404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33229a69-278d-49ea-9459-20986531c23f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:16.997586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 775/1551] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:16.999043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b177173-a440-4a80-9ced-c16941893369 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:16.999491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b177173-a440-4a80-9ced-c16941893369 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:16.999928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b177173-a440-4a80-9ced-c16941893369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.021559 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6b177173-a440-4a80-9ced-c16941893369 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.022792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6b177173-a440-4a80-9ced-c16941893369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.030642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 776/1552] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.031443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b177173-a440-4a80-9ced-c16941893369 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.043852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b177173-a440-4a80-9ced-c16941893369 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.048525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece477b-2c04-45c3-a467-70dc831be75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.049791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece477b-2c04-45c3-a467-70dc831be75a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.050125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece477b-2c04-45c3-a467-70dc831be75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.050410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece477b-2c04-45c3-a467-70dc831be75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.051143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece477b-2c04-45c3-a467-70dc831be75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.052801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece477b-2c04-45c3-a467-70dc831be75a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.063128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 777/1553] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:17.064193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a926cda-292d-45be-992d-65f63d90b93e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.064481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a926cda-292d-45be-992d-65f63d90b93e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.064838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a926cda-292d-45be-992d-65f63d90b93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.084022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5a926cda-292d-45be-992d-65f63d90b93e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.085214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5a926cda-292d-45be-992d-65f63d90b93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.093067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 778/1554] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.097532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1388-8215-4408-8d04-a93ded985b2c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.097532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1388-8215-4408-8d04-a93ded985b2c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.097532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1388-8215-4408-8d04-a93ded985b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.101237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:17.113277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b01b1388-8215-4408-8d04-a93ded985b2c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.114455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b01b1388-8215-4408-8d04-a93ded985b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.122149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 779/1555] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.123353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b914f9-dd26-4f02-9481-8ca2f6f40d29 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.123645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b914f9-dd26-4f02-9481-8ca2f6f40d29 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.123927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b914f9-dd26-4f02-9481-8ca2f6f40d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.134273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 777/1556] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:16 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:17.134273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9448b0-b5ae-4712-82b1-5f8b090d25ea None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.134273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9448b0-b5ae-4712-82b1-5f8b090d25ea None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.134273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9448b0-b5ae-4712-82b1-5f8b090d25ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.143161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-66b914f9-dd26-4f02-9481-8ca2f6f40d29 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.144406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-66b914f9-dd26-4f02-9481-8ca2f6f40d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.150708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-bd9448b0-b5ae-4712-82b1-5f8b090d25ea None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.151889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bd9448b0-b5ae-4712-82b1-5f8b090d25ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.152780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 780/1557] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.154245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dbcb1-97f0-4e4f-a3e2-35ba07679cd6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.161174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dbcb1-97f0-4e4f-a3e2-35ba07679cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.161174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dbcb1-97f0-4e4f-a3e2-35ba07679cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.162974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 778/1558] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.163908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9448b0-b5ae-4712-82b1-5f8b090d25ea None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.173746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9448b0-b5ae-4712-82b1-5f8b090d25ea None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.175262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5f0dbcb1-97f0-4e4f-a3e2-35ba07679cd6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.176485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5f0dbcb1-97f0-4e4f-a3e2-35ba07679cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.179181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29c0ca-13e2-4a03-a273-c8abe3864279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.179855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29c0ca-13e2-4a03-a273-c8abe3864279 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.180138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29c0ca-13e2-4a03-a273-c8abe3864279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.180413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29c0ca-13e2-4a03-a273-c8abe3864279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.181129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29c0ca-13e2-4a03-a273-c8abe3864279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.182757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29c0ca-13e2-4a03-a273-c8abe3864279 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.184769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 781/1559] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.186186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5a434-cf58-47ee-8f16-6b5537462323 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.192106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5a434-cf58-47ee-8f16-6b5537462323 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.192106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5a434-cf58-47ee-8f16-6b5537462323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.196097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 779/1560] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:17.196097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29c0ca-13e2-4a03-a273-c8abe3864279 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.205258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29c0ca-13e2-4a03-a273-c8abe3864279 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.207600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-afd5a434-cf58-47ee-8f16-6b5537462323 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.208867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-afd5a434-cf58-47ee-8f16-6b5537462323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.209884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.210536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.210821 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.211094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.211794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:17.212096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.213095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING py.warnings [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:15:17.213095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: warnings.warn(msg) May 30 12:15:17.213095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: May 30 12:15:17.213991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.217509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 782/1561] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.218397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5a434-cf58-47ee-8f16-6b5537462323 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.232369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 780/1562] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:17.232369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.232649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5a434-cf58-47ee-8f16-6b5537462323 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.238743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.239465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.239915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.240716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.241617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:17.241937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.243668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.243865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd6829-5062-4c63-b79f-280ebdcaf9ff admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.248453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755959-df6d-4537-828f-d4d2066cd97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.249093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755959-df6d-4537-828f-d4d2066cd97e admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.261804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755959-df6d-4537-828f-d4d2066cd97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.261804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755959-df6d-4537-828f-d4d2066cd97e admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.261804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68755959-df6d-4537-828f-d4d2066cd97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.261804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68755959-df6d-4537-828f-d4d2066cd97e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.262181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 783/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:17.262181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.266633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 781/1564] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:17.267683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c0f1c-9065-4452-9c55-5ed845c43c91 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.268347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0e89-52ca-42a9-b656-378ca8a8ad83 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.268561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0e89-52ca-42a9-b656-378ca8a8ad83 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.268882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0e89-52ca-42a9-b656-378ca8a8ad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.273367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.274065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.274451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.274589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.275330 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:17.275632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.277234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.287804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0dfc0e89-52ca-42a9-b656-378ca8a8ad83 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.289017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0dfc0e89-52ca-42a9-b656-378ca8a8ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.290249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 784/1565] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:17.291043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.300398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0785c8-3dec-4ba5-b696-c2f1bfc63b7c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.303399 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 782/1566] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.304283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0e89-52ca-42a9-b656-378ca8a8ad83 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.308307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374adea7-ae1d-4acf-84cc-0d7a56c1a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.308946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adea7-ae1d-4acf-84cc-0d7a56c1a609 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.309233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adea7-ae1d-4acf-84cc-0d7a56c1a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.309419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:17.309528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adea7-ae1d-4acf-84cc-0d7a56c1a609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.310379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374adea7-ae1d-4acf-84cc-0d7a56c1a609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:17.310573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374adea7-ae1d-4acf-84cc-0d7a56c1a609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.312164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374adea7-ae1d-4acf-84cc-0d7a56c1a609 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.314766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0e89-52ca-42a9-b656-378ca8a8ad83 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.319587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79758eb6-08fe-477d-aa04-e072803f0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.320484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758eb6-08fe-477d-aa04-e072803f0172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.320783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758eb6-08fe-477d-aa04-e072803f0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.321066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758eb6-08fe-477d-aa04-e072803f0172 admin admin] PATH_INFO: `/v3/projects/c935cdae7d4747e7bbb8f39a5787091d/users/acba6fb144c94f10b9f4fdab0443667b/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.323896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 785/1567] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:17.325270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473664d0-bff7-4222-a451-b39ac8149ba7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.325565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473664d0-bff7-4222-a451-b39ac8149ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.325844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473664d0-bff7-4222-a451-b39ac8149ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.337236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79758eb6-08fe-477d-aa04-e072803f0172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c935cdae7d4747e7bbb8f39a5787091d, user_id=acba6fb144c94f10b9f4fdab0443667b, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.340227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79758eb6-08fe-477d-aa04-e072803f0172 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.344224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-473664d0-bff7-4222-a451-b39ac8149ba7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.345744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-473664d0-bff7-4222-a451-b39ac8149ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.354595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 786/1568] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.355383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473664d0-bff7-4222-a451-b39ac8149ba7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.364753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473664d0-bff7-4222-a451-b39ac8149ba7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.369263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddf8d-e92b-4159-a2e0-7dc30ed3694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.371823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddf8d-e92b-4159-a2e0-7dc30ed3694b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.371823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddf8d-e92b-4159-a2e0-7dc30ed3694b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.371823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddf8d-e92b-4159-a2e0-7dc30ed3694b admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.371823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddf8d-e92b-4159-a2e0-7dc30ed3694b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.373177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddf8d-e92b-4159-a2e0-7dc30ed3694b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.421890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 783/1569] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:17 2022] PUT /identity/v3/projects/c935cdae7d4747e7bbb8f39a5787091d/users/acba6fb144c94f10b9f4fdab0443667b/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:17.422640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79758eb6-08fe-477d-aa04-e072803f0172 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.458419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 787/1570] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:17.459260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddf8d-e92b-4159-a2e0-7dc30ed3694b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.483911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79758eb6-08fe-477d-aa04-e072803f0172 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.521077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddf8d-e92b-4159-a2e0-7dc30ed3694b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.525652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17325dd5-aa1a-4102-80c4-5638532847ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.526512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17325dd5-aa1a-4102-80c4-5638532847ac admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.526808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17325dd5-aa1a-4102-80c4-5638532847ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.527082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17325dd5-aa1a-4102-80c4-5638532847ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.527806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17325dd5-aa1a-4102-80c4-5638532847ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.529401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17325dd5-aa1a-4102-80c4-5638532847ac admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.539755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 788/1571] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:17.540689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17325dd5-aa1a-4102-80c4-5638532847ac admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.544703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297901f2-8f9d-47bd-8b2d-bb567984d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.544703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297901f2-8f9d-47bd-8b2d-bb567984d3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.544703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297901f2-8f9d-47bd-8b2d-bb567984d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.544703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297901f2-8f9d-47bd-8b2d-bb567984d3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.545230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297901f2-8f9d-47bd-8b2d-bb567984d3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.547184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297901f2-8f9d-47bd-8b2d-bb567984d3f4 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.551070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17325dd5-aa1a-4102-80c4-5638532847ac admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.555795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57a388-fe1a-4428-a75f-adab6f746381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.556430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57a388-fe1a-4428-a75f-adab6f746381 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.556722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57a388-fe1a-4428-a75f-adab6f746381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.557007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57a388-fe1a-4428-a75f-adab6f746381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.557690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57a388-fe1a-4428-a75f-adab6f746381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.559702 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57a388-fe1a-4428-a75f-adab6f746381 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.677889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 784/1572] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/projects => generated 403 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:17.677889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297901f2-8f9d-47bd-8b2d-bb567984d3f4 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.704200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 789/1573] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:17.704200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57a388-fe1a-4428-a75f-adab6f746381 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.744182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297901f2-8f9d-47bd-8b2d-bb567984d3f4 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.755825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:17.759739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:17.773873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57a388-fe1a-4428-a75f-adab6f746381 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.778858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17535f-2a55-4f24-9a12-1802a4ff9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.779537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17535f-2a55-4f24-9a12-1802a4ff9263 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.786247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17535f-2a55-4f24-9a12-1802a4ff9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.786247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17535f-2a55-4f24-9a12-1802a4ff9263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.786247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17535f-2a55-4f24-9a12-1802a4ff9263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.786247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17535f-2a55-4f24-9a12-1802a4ff9263 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.802005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.802681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.802988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.803304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.804038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:17.804347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.806055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.818400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 785/1574] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:17.819188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.828331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcef446-e319-4084-a209-bacc42835889 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.833523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925a843-863d-4cb7-8644-fe1182f778e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.834171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a843-863d-4cb7-8644-fe1182f778e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.834460 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a843-863d-4cb7-8644-fe1182f778e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.834742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a843-863d-4cb7-8644-fe1182f778e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.835441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925a843-863d-4cb7-8644-fe1182f778e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:17.835750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925a843-863d-4cb7-8644-fe1182f778e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.837299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925a843-863d-4cb7-8644-fe1182f778e2 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.848503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 786/1575] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:17.849648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4463-1cef-4c18-9bb2-97a6675b8bf2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.849939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4463-1cef-4c18-9bb2-97a6675b8bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.850249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4463-1cef-4c18-9bb2-97a6675b8bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.869173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 790/1576] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:17.870226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17535f-2a55-4f24-9a12-1802a4ff9263 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.875574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-de4f4463-1cef-4c18-9bb2-97a6675b8bf2 None None] MFA Rules not processed for user `acba6fb144c94f10b9f4fdab0443667b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:17.876858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-de4f4463-1cef-4c18-9bb2-97a6675b8bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:17.932363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17535f-2a55-4f24-9a12-1802a4ff9263 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.936943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7cf24-6763-4c9f-ac6f-ff7930b675ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.937665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7cf24-6763-4c9f-ac6f-ff7930b675ec admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.937974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7cf24-6763-4c9f-ac6f-ff7930b675ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.938269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7cf24-6763-4c9f-ac6f-ff7930b675ec admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.938958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7cf24-6763-4c9f-ac6f-ff7930b675ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.940940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7cf24-6763-4c9f-ac6f-ff7930b675ec admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:17.944085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 787/1577] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:17.944897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4463-1cef-4c18-9bb2-97a6675b8bf2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:17.955300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4463-1cef-4c18-9bb2-97a6675b8bf2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:17.960359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d0e7-1eb2-4afc-99de-193b97ce55cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:17.961261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d0e7-1eb2-4afc-99de-193b97ce55cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:17.961544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d0e7-1eb2-4afc-99de-193b97ce55cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:17.967920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d0e7-1eb2-4afc-99de-193b97ce55cb admin admin] PATH_INFO: `/v3/projects/4538b18a36d843058fd43df98ded9c41/users/e32767611f7d417184f55c8e7fa645b4/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:17.976350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04d0e7-1eb2-4afc-99de-193b97ce55cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4538b18a36d843058fd43df98ded9c41, user_id=e32767611f7d417184f55c8e7fa645b4, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:17.979077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04d0e7-1eb2-4afc-99de-193b97ce55cb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.021871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 791/1578] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:17 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.022749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7cf24-6763-4c9f-ac6f-ff7930b675ec admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.032054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7cf24-6763-4c9f-ac6f-ff7930b675ec admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.036979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48559-0960-4401-8187-84c0ecf5e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.037612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48559-0960-4401-8187-84c0ecf5e9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.037912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48559-0960-4401-8187-84c0ecf5e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.038216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d48559-0960-4401-8187-84c0ecf5e9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.038919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d48559-0960-4401-8187-84c0ecf5e9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.040843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d48559-0960-4401-8187-84c0ecf5e9e2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.050546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 788/1579] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:17 2022] PUT /identity/v3/projects/4538b18a36d843058fd43df98ded9c41/users/e32767611f7d417184f55c8e7fa645b4/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:18.051908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d0e7-1eb2-4afc-99de-193b97ce55cb admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.110729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d0e7-1eb2-4afc-99de-193b97ce55cb admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.115879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fdefd-0786-47ce-8987-6d5c3003ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.116556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdefd-0786-47ce-8987-6d5c3003ccba admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.116898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdefd-0786-47ce-8987-6d5c3003ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.117233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdefd-0786-47ce-8987-6d5c3003ccba admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.117922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fdefd-0786-47ce-8987-6d5c3003ccba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.120012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fdefd-0786-47ce-8987-6d5c3003ccba admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.128631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:18.147962 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 792/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/users => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.149031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48559-0960-4401-8187-84c0ecf5e9e2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.159082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d48559-0960-4401-8187-84c0ecf5e9e2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.163250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0d3f9-d2cf-4b3f-9118-3c681456c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.163868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0d3f9-d2cf-4b3f-9118-3c681456c26d admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.164155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0d3f9-d2cf-4b3f-9118-3c681456c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.164434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0d3f9-d2cf-4b3f-9118-3c681456c26d admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.165103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0d3f9-d2cf-4b3f-9118-3c681456c26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.167035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0d3f9-d2cf-4b3f-9118-3c681456c26d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.263816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 789/1581] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.263816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fdefd-0786-47ce-8987-6d5c3003ccba admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.272360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fdefd-0786-47ce-8987-6d5c3003ccba admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.276872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6310-d8dc-4715-a740-948017b9974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.277502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6310-d8dc-4715-a740-948017b9974c admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.277795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6310-d8dc-4715-a740-948017b9974c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.278117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6310-d8dc-4715-a740-948017b9974c admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.278797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c6310-d8dc-4715-a740-948017b9974c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.280703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c6310-d8dc-4715-a740-948017b9974c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.340109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 793/1582] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/projects => generated 389 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.340109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0d3f9-d2cf-4b3f-9118-3c681456c26d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.396447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0d3f9-d2cf-4b3f-9118-3c681456c26d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.401100 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccacf-7159-4f83-807c-3332433e10ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.401763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccacf-7159-4f83-807c-3332433e10ae admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.402082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccacf-7159-4f83-807c-3332433e10ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.402369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccacf-7159-4f83-807c-3332433e10ae admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.403053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccacf-7159-4f83-807c-3332433e10ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.404969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccacf-7159-4f83-807c-3332433e10ae admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.422966 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 790/1583] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.423899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6310-d8dc-4715-a740-948017b9974c admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.483761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6310-d8dc-4715-a740-948017b9974c admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.488280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624dfc9-ccf7-4b30-a34c-77adb536f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.488927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624dfc9-ccf7-4b30-a34c-77adb536f1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.489218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624dfc9-ccf7-4b30-a34c-77adb536f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.489495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624dfc9-ccf7-4b30-a34c-77adb536f1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.490204 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624dfc9-ccf7-4b30-a34c-77adb536f1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.492683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624dfc9-ccf7-4b30-a34c-77adb536f1cb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.530631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 794/1584] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.531414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccacf-7159-4f83-807c-3332433e10ae admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.541611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccacf-7159-4f83-807c-3332433e10ae admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.546186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b7e86-6d12-4e08-a636-1a9939767a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.546821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b7e86-6d12-4e08-a636-1a9939767a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.547113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b7e86-6d12-4e08-a636-1a9939767a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.547379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b7e86-6d12-4e08-a636-1a9939767a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.548088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b7e86-6d12-4e08-a636-1a9939767a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.549672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b7e86-6d12-4e08-a636-1a9939767a00 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.550953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:18.560365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 795/1585] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:18.561604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66761c2-d44b-4799-a5b1-b033a17afa5f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.561896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66761c2-d44b-4799-a5b1-b033a17afa5f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.562195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66761c2-d44b-4799-a5b1-b033a17afa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.578387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c66761c2-d44b-4799-a5b1-b033a17afa5f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:18.579549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c66761c2-d44b-4799-a5b1-b033a17afa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:18.586841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 796/1586] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:18.587763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66761c2-d44b-4799-a5b1-b033a17afa5f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.597524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66761c2-d44b-4799-a5b1-b033a17afa5f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.602420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0111624-a791-4548-9688-6862e6a630af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.603186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111624-a791-4548-9688-6862e6a630af admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.603475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111624-a791-4548-9688-6862e6a630af admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.603771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0111624-a791-4548-9688-6862e6a630af admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.604472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0111624-a791-4548-9688-6862e6a630af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.606143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0111624-a791-4548-9688-6862e6a630af admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.615706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 797/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:18.616475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0111624-a791-4548-9688-6862e6a630af admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.626425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0111624-a791-4548-9688-6862e6a630af admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.631356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69deb26-9fd0-4773-91fd-c603b14eabf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.631977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69deb26-9fd0-4773-91fd-c603b14eabf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.632283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69deb26-9fd0-4773-91fd-c603b14eabf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.632564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69deb26-9fd0-4773-91fd-c603b14eabf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.633294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69deb26-9fd0-4773-91fd-c603b14eabf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.637844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 791/1588] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.638013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69deb26-9fd0-4773-91fd-c603b14eabf0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.638112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624dfc9-ccf7-4b30-a34c-77adb536f1cb admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.645900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 798/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:18.645900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69deb26-9fd0-4773-91fd-c603b14eabf0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.656595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69deb26-9fd0-4773-91fd-c603b14eabf0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.698977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624dfc9-ccf7-4b30-a34c-77adb536f1cb admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.703836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ea7cf-cba8-4da5-ad7d-bcbfde337a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.704512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ea7cf-cba8-4da5-ad7d-bcbfde337a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.704795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ea7cf-cba8-4da5-ad7d-bcbfde337a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.705076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ea7cf-cba8-4da5-ad7d-bcbfde337a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.705847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ea7cf-cba8-4da5-ad7d-bcbfde337a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.707817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ea7cf-cba8-4da5-ad7d-bcbfde337a6a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.715577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ec334-591d-4782-8428-6b037310ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.716274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec334-591d-4782-8428-6b037310ab3d admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.716553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec334-591d-4782-8428-6b037310ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.716824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec334-591d-4782-8428-6b037310ab3d admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.717505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ec334-591d-4782-8428-6b037310ab3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.719447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ec334-591d-4782-8428-6b037310ab3d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.816017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 792/1590] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.816790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ea7cf-cba8-4da5-ad7d-bcbfde337a6a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.826188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ea7cf-cba8-4da5-ad7d-bcbfde337a6a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.831097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1a911-ee9d-488f-a3b5-842dd4210e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.831814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a911-ee9d-488f-a3b5-842dd4210e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.832126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a911-ee9d-488f-a3b5-842dd4210e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.832406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a911-ee9d-488f-a3b5-842dd4210e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.833113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1a911-ee9d-488f-a3b5-842dd4210e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.834751 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1a911-ee9d-488f-a3b5-842dd4210e6b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.845161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 793/1591] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:18.845914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1a911-ee9d-488f-a3b5-842dd4210e6b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.855591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1a911-ee9d-488f-a3b5-842dd4210e6b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.859279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 799/1592] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:18.859279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ec334-591d-4782-8428-6b037310ab3d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.861156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279026-ca62-4560-a243-18d871a029ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.861794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279026-ca62-4560-a243-18d871a029ee admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.862113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279026-ca62-4560-a243-18d871a029ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.862392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279026-ca62-4560-a243-18d871a029ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.863108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279026-ca62-4560-a243-18d871a029ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.864691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279026-ca62-4560-a243-18d871a029ee admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.876283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 794/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:18.876916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279026-ca62-4560-a243-18d871a029ee admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.886305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279026-ca62-4560-a243-18d871a029ee admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.890952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360748a-927c-470b-9ff9-e9fe388e6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.891722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360748a-927c-470b-9ff9-e9fe388e6283 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.892004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360748a-927c-470b-9ff9-e9fe388e6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.892283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360748a-927c-470b-9ff9-e9fe388e6283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.892993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360748a-927c-470b-9ff9-e9fe388e6283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.894762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360748a-927c-470b-9ff9-e9fe388e6283 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.904520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 795/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:18.905283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360748a-927c-470b-9ff9-e9fe388e6283 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.916623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ec334-591d-4782-8428-6b037310ab3d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.917780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360748a-927c-470b-9ff9-e9fe388e6283 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.920339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab6ebf-a710-4498-9775-44db72ce5fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.920990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab6ebf-a710-4498-9775-44db72ce5fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.921276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab6ebf-a710-4498-9775-44db72ce5fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.921552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab6ebf-a710-4498-9775-44db72ce5fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.923316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10129-edd0-4984-b59c-7639c24c780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.923962 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10129-edd0-4984-b59c-7639c24c780d admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.924258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10129-edd0-4984-b59c-7639c24c780d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.924542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10129-edd0-4984-b59c-7639c24c780d admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.925302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c10129-edd0-4984-b59c-7639c24c780d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.927454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c10129-edd0-4984-b59c-7639c24c780d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.931291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab6ebf-a710-4498-9775-44db72ce5fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.932725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab6ebf-a710-4498-9775-44db72ce5fe5 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.937066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:18.943649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 800/1595] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:18.956546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab6ebf-a710-4498-9775-44db72ce5fe5 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.956546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab6ebf-a710-4498-9775-44db72ce5fe5 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.957670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7665df-e33b-4581-af6b-483281e30bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.958344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7665df-e33b-4581-af6b-483281e30bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.958630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7665df-e33b-4581-af6b-483281e30bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.958912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7665df-e33b-4581-af6b-483281e30bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.959623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7665df-e33b-4581-af6b-483281e30bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.961204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7665df-e33b-4581-af6b-483281e30bf0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:18.971874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 801/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:18.972662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7665df-e33b-4581-af6b-483281e30bf0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:18.983403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7665df-e33b-4581-af6b-483281e30bf0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:18.988991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68da84d-f6ee-442c-b5e9-4187acbe1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:18.996079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68da84d-f6ee-442c-b5e9-4187acbe1a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:18.996079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68da84d-f6ee-442c-b5e9-4187acbe1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:18.996079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68da84d-f6ee-442c-b5e9-4187acbe1a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:18.996079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68da84d-f6ee-442c-b5e9-4187acbe1a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:18.996079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68da84d-f6ee-442c-b5e9-4187acbe1a43 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.002723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 802/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:19.003583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68da84d-f6ee-442c-b5e9-4187acbe1a43 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.013091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68da84d-f6ee-442c-b5e9-4187acbe1a43 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.017929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b7339-b337-42c6-9a60-7729601d9de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.018571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b7339-b337-42c6-9a60-7729601d9de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.018859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b7339-b337-42c6-9a60-7729601d9de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.019137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b7339-b337-42c6-9a60-7729601d9de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.019834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b7339-b337-42c6-9a60-7729601d9de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.021421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b7339-b337-42c6-9a60-7729601d9de7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.031709 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 803/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:19.032982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b7339-b337-42c6-9a60-7729601d9de7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.042631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b7339-b337-42c6-9a60-7729601d9de7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.047157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23e2dd-4193-484d-8cbf-7bc322dc25b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.048309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23e2dd-4193-484d-8cbf-7bc322dc25b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.048712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23e2dd-4193-484d-8cbf-7bc322dc25b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.049049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23e2dd-4193-484d-8cbf-7bc322dc25b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.049632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23e2dd-4193-484d-8cbf-7bc322dc25b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.051233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23e2dd-4193-484d-8cbf-7bc322dc25b9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.057523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 796/1599] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:18 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:19.057523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10129-edd0-4984-b59c-7639c24c780d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.071947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 804/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:19.071947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23e2dd-4193-484d-8cbf-7bc322dc25b9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.072127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10129-edd0-4984-b59c-7639c24c780d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.072668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6a906-ddfc-4551-8874-c4156eac817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.073098 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23e2dd-4193-484d-8cbf-7bc322dc25b9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.073676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a906-ddfc-4551-8874-c4156eac817d admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.073949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a906-ddfc-4551-8874-c4156eac817d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.074248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a906-ddfc-4551-8874-c4156eac817d admin admin] PATH_INFO: `/v3/projects/91a54feb061c49f59d63f3b21c6b9b6b/users/00e99aa4e6c14e7bafa57df2c867e9a3/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.078277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.079200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.079520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.079845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] PATH_INFO: `/v3/projects/344d3e82481e47d2ba65b2806de7de61/users/45fcc5b11a8d4958babc4b48a9357119/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.089568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6a906-ddfc-4551-8874-c4156eac817d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a54feb061c49f59d63f3b21c6b9b6b, user_id=00e99aa4e6c14e7bafa57df2c867e9a3, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.092008 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:19.092469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6a906-ddfc-4551-8874-c4156eac817d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.096028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=344d3e82481e47d2ba65b2806de7de61, user_id=45fcc5b11a8d4958babc4b48a9357119, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.097190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:15:19.097190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: warnings.warn(msg) May 30 12:15:19.097190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: May 30 12:15:19.099226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.246577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 805/1602] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:19 2022] PUT /identity/v3/projects/344d3e82481e47d2ba65b2806de7de61/users/45fcc5b11a8d4958babc4b48a9357119/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:19.246800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 797/1602] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:19 2022] PUT /identity/v3/projects/91a54feb061c49f59d63f3b21c6b9b6b/users/00e99aa4e6c14e7bafa57df2c867e9a3/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:19.246918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.247017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6a906-ddfc-4551-8874-c4156eac817d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.308209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ed5b-dc02-484b-8dfa-74b82bdc8c3f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.314801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6a906-ddfc-4551-8874-c4156eac817d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.315557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a8070-b50e-48e8-8e77-b502e71085bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.315557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a8070-b50e-48e8-8e77-b502e71085bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.315557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a8070-b50e-48e8-8e77-b502e71085bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.315557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a8070-b50e-48e8-8e77-b502e71085bd admin admin] PATH_INFO: `/v3/projects/5e3344f3dfdc426fbbb2005f4681b2b0/users/46b0e382c8f8430c9bb7640ca51a74c7/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.315921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dcb6c-bdf0-4524-85e6-b96eb76fcbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.315921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcb6c-bdf0-4524-85e6-b96eb76fcbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.316097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcb6c-bdf0-4524-85e6-b96eb76fcbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.316603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcb6c-bdf0-4524-85e6-b96eb76fcbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.317434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcb6c-bdf0-4524-85e6-b96eb76fcbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.319087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcb6c-bdf0-4524-85e6-b96eb76fcbf4 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.330678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a8070-b50e-48e8-8e77-b502e71085bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3344f3dfdc426fbbb2005f4681b2b0, user_id=46b0e382c8f8430c9bb7640ca51a74c7, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.333360 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a8070-b50e-48e8-8e77-b502e71085bd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.340245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 798/1603] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:19.340245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dcb6c-bdf0-4524-85e6-b96eb76fcbf4 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.347981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dcb6c-bdf0-4524-85e6-b96eb76fcbf4 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.353084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f728-bc67-48d0-97ef-5f713f945aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.354018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f728-bc67-48d0-97ef-5f713f945aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.354292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f728-bc67-48d0-97ef-5f713f945aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.354576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f728-bc67-48d0-97ef-5f713f945aaf admin admin] PATH_INFO: `/v3/projects/c14e9aa3f9c04e139f39cb44aee2faa5/users/ca4253905b5d4a80ad8dcfe72f11ae34/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.370120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f728-bc67-48d0-97ef-5f713f945aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14e9aa3f9c04e139f39cb44aee2faa5, user_id=ca4253905b5d4a80ad8dcfe72f11ae34, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.372916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f728-bc67-48d0-97ef-5f713f945aaf admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.399434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 806/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:19 2022] PUT /identity/v3/projects/5e3344f3dfdc426fbbb2005f4681b2b0/users/46b0e382c8f8430c9bb7640ca51a74c7/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:19.400343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a8070-b50e-48e8-8e77-b502e71085bd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.460183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a8070-b50e-48e8-8e77-b502e71085bd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.464828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318f117-8f2a-4e99-9e09-68779b60069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.465489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318f117-8f2a-4e99-9e09-68779b60069e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.465773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318f117-8f2a-4e99-9e09-68779b60069e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.466168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318f117-8f2a-4e99-9e09-68779b60069e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.466915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318f117-8f2a-4e99-9e09-68779b60069e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.468524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318f117-8f2a-4e99-9e09-68779b60069e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.474307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 799/1605] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:19 2022] PUT /identity/v3/projects/c14e9aa3f9c04e139f39cb44aee2faa5/users/ca4253905b5d4a80ad8dcfe72f11ae34/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:19.475211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f728-bc67-48d0-97ef-5f713f945aaf admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.487397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 807/1606] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:19.488914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc19a4-c2b8-43ce-8877-4d187d9770c8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.489302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc19a4-c2b8-43ce-8877-4d187d9770c8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.489705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc19a4-c2b8-43ce-8877-4d187d9770c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.508068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ebbc19a4-c2b8-43ce-8877-4d187d9770c8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:19.509681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ebbc19a4-c2b8-43ce-8877-4d187d9770c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:19.542897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f728-bc67-48d0-97ef-5f713f945aaf admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.550799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792b37-a9d8-419c-84fb-6321b5367c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.551760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792b37-a9d8-419c-84fb-6321b5367c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.551911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792b37-a9d8-419c-84fb-6321b5367c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.552555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792b37-a9d8-419c-84fb-6321b5367c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.553335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792b37-a9d8-419c-84fb-6321b5367c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.556154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72792b37-a9d8-419c-84fb-6321b5367c6e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.570722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 800/1607] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:19.570722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594540f-cbb4-4872-81e0-ccd59a6314bb None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.570722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594540f-cbb4-4872-81e0-ccd59a6314bb None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.570722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594540f-cbb4-4872-81e0-ccd59a6314bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.577738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 808/1608] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:19.582793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc19a4-c2b8-43ce-8877-4d187d9770c8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.589094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc19a4-c2b8-43ce-8877-4d187d9770c8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.598961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568c933-3d2e-4fa4-811f-fc6951946944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.599956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c933-3d2e-4fa4-811f-fc6951946944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.600323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c933-3d2e-4fa4-811f-fc6951946944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.600714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c933-3d2e-4fa4-811f-fc6951946944 admin admin] PATH_INFO: `/v3/projects/c27e5dcbd9bf4393b075f9837651e5c7/users/4705101941674ef0839a6cff5d1bab2f/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.610047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-1594540f-cbb4-4872-81e0-ccd59a6314bb None None] MFA Rules not processed for user `45fcc5b11a8d4958babc4b48a9357119`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:19.613624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:19.613758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1594540f-cbb4-4872-81e0-ccd59a6314bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:19.617825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568c933-3d2e-4fa4-811f-fc6951946944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27e5dcbd9bf4393b075f9837651e5c7, user_id=4705101941674ef0839a6cff5d1bab2f, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.621294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568c933-3d2e-4fa4-811f-fc6951946944 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.648658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:19.684814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 801/1609] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:19.686439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23c28-10de-4cb8-b85b-b85f1fee32b0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.686736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23c28-10de-4cb8-b85b-b85f1fee32b0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.687021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23c28-10de-4cb8-b85b-b85f1fee32b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.705313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5fa23c28-10de-4cb8-b85b-b85f1fee32b0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:19.711071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5fa23c28-10de-4cb8-b85b-b85f1fee32b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:19.714373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 802/1610] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:19.715600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fd11b-6c0c-4f3b-bbfa-026c73cc4ba6 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.715897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fd11b-6c0c-4f3b-bbfa-026c73cc4ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.716199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fd11b-6c0c-4f3b-bbfa-026c73cc4ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.742096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ee0fd11b-6c0c-4f3b-bbfa-026c73cc4ba6 None None] MFA Rules not processed for user `ca4253905b5d4a80ad8dcfe72f11ae34`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:19.743291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ee0fd11b-6c0c-4f3b-bbfa-026c73cc4ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:19.764841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 809/1611] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:19 2022] PUT /identity/v3/projects/c27e5dcbd9bf4393b075f9837651e5c7/users/4705101941674ef0839a6cff5d1bab2f/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:19.765721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568c933-3d2e-4fa4-811f-fc6951946944 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.811298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 803/1612] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:19.811933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fd11b-6c0c-4f3b-bbfa-026c73cc4ba6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:19.823677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fd11b-6c0c-4f3b-bbfa-026c73cc4ba6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.840861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568c933-3d2e-4fa4-811f-fc6951946944 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:19.846658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430adfd-a1e1-45ff-a5f3-8dd48d7a8531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.852439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430adfd-a1e1-45ff-a5f3-8dd48d7a8531 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.852439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430adfd-a1e1-45ff-a5f3-8dd48d7a8531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.852439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430adfd-a1e1-45ff-a5f3-8dd48d7a8531 admin admin] PATH_INFO: `/v3/projects/01c25af0323941c4825f94f2bf3e2c51/users/8017acb0c46c41988bd880d2aa25ae56/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.865714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430adfd-a1e1-45ff-a5f3-8dd48d7a8531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c25af0323941c4825f94f2bf3e2c51, user_id=8017acb0c46c41988bd880d2aa25ae56, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.869650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430adfd-a1e1-45ff-a5f3-8dd48d7a8531 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:19.892098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe5357-22a1-469b-8090-fcab2552598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:19.892989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5357-22a1-469b-8090-fcab2552598d admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:19.893275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5357-22a1-469b-8090-fcab2552598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:19.893548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5357-22a1-469b-8090-fcab2552598d admin admin] PATH_INFO: `/v3/projects/44bc3d12929848eda3f2a7658642d532/users/8d419d0520ed48b181dc528aff6364fc/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:19.908318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe5357-22a1-469b-8090-fcab2552598d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44bc3d12929848eda3f2a7658642d532, user_id=8d419d0520ed48b181dc528aff6364fc, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:19.911060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe5357-22a1-469b-8090-fcab2552598d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.027899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 810/1613] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:19 2022] PUT /identity/v3/projects/01c25af0323941c4825f94f2bf3e2c51/users/8017acb0c46c41988bd880d2aa25ae56/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:20.028120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 804/1614] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:19 2022] PUT /identity/v3/projects/44bc3d12929848eda3f2a7658642d532/users/8d419d0520ed48b181dc528aff6364fc/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:20.028790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe5357-22a1-469b-8090-fcab2552598d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.029045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430adfd-a1e1-45ff-a5f3-8dd48d7a8531 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.072039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:20.094609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430adfd-a1e1-45ff-a5f3-8dd48d7a8531 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.094609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966910-8559-4993-8124-62511a66f38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.094609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966910-8559-4993-8124-62511a66f38b service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.094609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966910-8559-4993-8124-62511a66f38b service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.095478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966910-8559-4993-8124-62511a66f38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.095761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe5357-22a1-469b-8090-fcab2552598d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.157630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5252a-54f5-4d9e-9adb-46e02a372f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.158168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8966910-8559-4993-8124-62511a66f38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.158358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5252a-54f5-4d9e-9adb-46e02a372f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.158647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5252a-54f5-4d9e-9adb-46e02a372f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.158928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5252a-54f5-4d9e-9adb-46e02a372f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.159622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5252a-54f5-4d9e-9adb-46e02a372f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.159741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8966910-8559-4993-8124-62511a66f38b service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.161786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5252a-54f5-4d9e-9adb-46e02a372f1e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.170163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 811/1615] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:20.171043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966910-8559-4993-8124-62511a66f38b service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.179796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966910-8559-4993-8124-62511a66f38b service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.184490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21482abf-a3de-4daf-bca5-1b1f69dd094d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.186443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21482abf-a3de-4daf-bca5-1b1f69dd094d service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.186443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21482abf-a3de-4daf-bca5-1b1f69dd094d service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.186443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21482abf-a3de-4daf-bca5-1b1f69dd094d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.199342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21482abf-a3de-4daf-bca5-1b1f69dd094d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.200827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21482abf-a3de-4daf-bca5-1b1f69dd094d service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.210516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 812/1616] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:20.212803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e764-775a-46da-8fed-e0f2e4ae8ae7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.213164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e764-775a-46da-8fed-e0f2e4ae8ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.213600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e764-775a-46da-8fed-e0f2e4ae8ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.225674 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:20.232441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7f58e764-775a-46da-8fed-e0f2e4ae8ae7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:20.233698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7f58e764-775a-46da-8fed-e0f2e4ae8ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:20.242406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 813/1617] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:20.243719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea305d-9df3-4a7b-b54f-282d5e29b43b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.243981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea305d-9df3-4a7b-b54f-282d5e29b43b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.250084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea305d-9df3-4a7b-b54f-282d5e29b43b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.250084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 814/1618] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 30 12:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:20.250084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542e13-2fd6-4d35-8eec-4e7a6aa5b153 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.250084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542e13-2fd6-4d35-8eec-4e7a6aa5b153 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.250084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542e13-2fd6-4d35-8eec-4e7a6aa5b153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.264708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-36542e13-2fd6-4d35-8eec-4e7a6aa5b153 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:20.265885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-36542e13-2fd6-4d35-8eec-4e7a6aa5b153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:20.273981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 815/1619] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:20.274697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36542e13-2fd6-4d35-8eec-4e7a6aa5b153 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.278970 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 805/1620] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:20 2022] POST /identity/v3/projects => generated 405 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:20.281203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d786c-6600-4cae-9751-0191a21a7143 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.281515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d786c-6600-4cae-9751-0191a21a7143 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.281897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d786c-6600-4cae-9751-0191a21a7143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.287902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36542e13-2fd6-4d35-8eec-4e7a6aa5b153 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.310661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-934d786c-6600-4cae-9751-0191a21a7143 None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:20.312166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-934d786c-6600-4cae-9751-0191a21a7143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:20.348776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b041-618e-49a8-8ea6-3a2a932f3f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.349367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b041-618e-49a8-8ea6-3a2a932f3f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.349658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b041-618e-49a8-8ea6-3a2a932f3f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.349939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b041-618e-49a8-8ea6-3a2a932f3f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.350817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743b041-618e-49a8-8ea6-3a2a932f3f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.352525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743b041-618e-49a8-8ea6-3a2a932f3f29 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.370306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 816/1621] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:20.371568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b041-618e-49a8-8ea6-3a2a932f3f29 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.390021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 806/1622] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 30 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:20.400535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d786c-6600-4cae-9751-0191a21a7143 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.412721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d786c-6600-4cae-9751-0191a21a7143 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.428913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edf7cc-8c7e-4344-82b4-28bded062985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.430688 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf7cc-8c7e-4344-82b4-28bded062985 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.430992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf7cc-8c7e-4344-82b4-28bded062985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.431271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf7cc-8c7e-4344-82b4-28bded062985 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.431991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edf7cc-8c7e-4344-82b4-28bded062985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.434059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edf7cc-8c7e-4344-82b4-28bded062985 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.458122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b041-618e-49a8-8ea6-3a2a932f3f29 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.462336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70c5a5-cf21-4631-85c2-1ab67f2ba477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.465576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c5a5-cf21-4631-85c2-1ab67f2ba477 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.465576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c5a5-cf21-4631-85c2-1ab67f2ba477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.465576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c5a5-cf21-4631-85c2-1ab67f2ba477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.475053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70c5a5-cf21-4631-85c2-1ab67f2ba477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.476923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70c5a5-cf21-4631-85c2-1ab67f2ba477 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.490585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 817/1623] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:20.495139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70c5a5-cf21-4631-85c2-1ab67f2ba477 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.506124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70c5a5-cf21-4631-85c2-1ab67f2ba477 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.511800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389beda-da11-499b-93d0-e618a0b2fec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.512204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389beda-da11-499b-93d0-e618a0b2fec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.512566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389beda-da11-499b-93d0-e618a0b2fec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.513292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389beda-da11-499b-93d0-e618a0b2fec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.539597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389beda-da11-499b-93d0-e618a0b2fec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.540359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389beda-da11-499b-93d0-e618a0b2fec3 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.557055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 818/1624] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:20.568577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 807/1625] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:20 2022] POST /identity/v3/users => generated 309 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:20.568577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edf7cc-8c7e-4344-82b4-28bded062985 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.569411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389beda-da11-499b-93d0-e618a0b2fec3 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.590893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389beda-da11-499b-93d0-e618a0b2fec3 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.591394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edf7cc-8c7e-4344-82b4-28bded062985 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.607137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791a9b-c8d9-4fdd-83b8-83ee75fc51ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.607919 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791a9b-c8d9-4fdd-83b8-83ee75fc51ba service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.608312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791a9b-c8d9-4fdd-83b8-83ee75fc51ba service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.609074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791a9b-c8d9-4fdd-83b8-83ee75fc51ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.610446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390cd2f-788d-4873-9ba5-3bd7a316af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.613837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390cd2f-788d-4873-9ba5-3bd7a316af22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.614078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390cd2f-788d-4873-9ba5-3bd7a316af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.614278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390cd2f-788d-4873-9ba5-3bd7a316af22 admin admin] PATH_INFO: `/v3/projects/01c25af0323941c4825f94f2bf3e2c51/users/8017acb0c46c41988bd880d2aa25ae56/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.621201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390cd2f-788d-4873-9ba5-3bd7a316af22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c25af0323941c4825f94f2bf3e2c51, user_id=8017acb0c46c41988bd880d2aa25ae56, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.625441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390cd2f-788d-4873-9ba5-3bd7a316af22 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.652456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 819/1626] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:20 2022] PUT /identity/v3/projects/01c25af0323941c4825f94f2bf3e2c51/users/8017acb0c46c41988bd880d2aa25ae56/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:20.653172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390cd2f-788d-4873-9ba5-3bd7a316af22 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.743908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83791a9b-c8d9-4fdd-83b8-83ee75fc51ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.750880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83791a9b-c8d9-4fdd-83b8-83ee75fc51ba service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.758756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 808/1627] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:20.761095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ca07a-08c4-42a0-9a7f-446cc50b2d86 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.761631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ca07a-08c4-42a0-9a7f-446cc50b2d86 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.762153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ca07a-08c4-42a0-9a7f-446cc50b2d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.773332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390cd2f-788d-4873-9ba5-3bd7a316af22 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.779950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a1aa4-ef51-4e9f-91c9-d27798b7db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.780502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1aa4-ef51-4e9f-91c9-d27798b7db60 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.780794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1aa4-ef51-4e9f-91c9-d27798b7db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.781125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a1aa4-ef51-4e9f-91c9-d27798b7db60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.781866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a1aa4-ef51-4e9f-91c9-d27798b7db60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.784292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a1aa4-ef51-4e9f-91c9-d27798b7db60 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.796284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-bf4ca07a-08c4-42a0-9a7f-446cc50b2d86 None None] MFA Rules not processed for user `8017acb0c46c41988bd880d2aa25ae56`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:20.798374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 820/1628] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:20.802135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bf4ca07a-08c4-42a0-9a7f-446cc50b2d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:20.802931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a1aa4-ef51-4e9f-91c9-d27798b7db60 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.817287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a1aa4-ef51-4e9f-91c9-d27798b7db60 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:20.823983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15df85-1485-47ef-97ae-153e8ed47d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:20.825040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15df85-1485-47ef-97ae-153e8ed47d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:20.825605 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15df85-1485-47ef-97ae-153e8ed47d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:20.826160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15df85-1485-47ef-97ae-153e8ed47d58 admin admin] PATH_INFO: `/v3/projects/9e9b531e951f4127b76b996ba3e95c8d/users/00d2fa1cdd5b4976a0b12026821d7e2b/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:20.846631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15df85-1485-47ef-97ae-153e8ed47d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9b531e951f4127b76b996ba3e95c8d, user_id=00d2fa1cdd5b4976a0b12026821d7e2b, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:20.849912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15df85-1485-47ef-97ae-153e8ed47d58 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:20.906541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 809/1629] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:20.917669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ca07a-08c4-42a0-9a7f-446cc50b2d86 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:20.927750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:20.951312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 821/1630] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:20 2022] PUT /identity/v3/projects/9e9b531e951f4127b76b996ba3e95c8d/users/00d2fa1cdd5b4976a0b12026821d7e2b/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:20.956763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15df85-1485-47ef-97ae-153e8ed47d58 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:21.063123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ca07a-08c4-42a0-9a7f-446cc50b2d86 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:21.088022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15df85-1485-47ef-97ae-153e8ed47d58 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:21.090101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:21.095331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9a93a-91d2-47ec-bd8c-8866114615a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:21.097034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9a93a-91d2-47ec-bd8c-8866114615a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.097162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9a93a-91d2-47ec-bd8c-8866114615a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.097411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9a93a-91d2-47ec-bd8c-8866114615a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.098187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9a93a-91d2-47ec-bd8c-8866114615a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:21.105067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9a93a-91d2-47ec-bd8c-8866114615a4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:21.120225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 822/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:21.121812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bbd4b-af87-4cd9-ae73-17b3ab6ee60f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.122564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bbd4b-af87-4cd9-ae73-17b3ab6ee60f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.122564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bbd4b-af87-4cd9-ae73-17b3ab6ee60f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.123833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 823/1632] 10.222.0.48 () {54 vars in 912 bytes} [Mon May 30 12:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:21.124572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bbd4b-af87-4cd9-ae73-17b3ab6ee60f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:21.137910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610e7c6-1425-4285-8de4-fa8cabea4f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:21.139104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610e7c6-1425-4285-8de4-fa8cabea4f88 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.139418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610e7c6-1425-4285-8de4-fa8cabea4f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.139706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610e7c6-1425-4285-8de4-fa8cabea4f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.141356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bbd4b-af87-4cd9-ae73-17b3ab6ee60f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:21.147062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63695520-8f0a-435e-8c92-1fd9a57877d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:21.150044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695520-8f0a-435e-8c92-1fd9a57877d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.150044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695520-8f0a-435e-8c92-1fd9a57877d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.150044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695520-8f0a-435e-8c92-1fd9a57877d6 admin admin] PATH_INFO: `/v3/projects/9e9b531e951f4127b76b996ba3e95c8d/users/00d2fa1cdd5b4976a0b12026821d7e2b/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.153167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63695520-8f0a-435e-8c92-1fd9a57877d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9b531e951f4127b76b996ba3e95c8d, user_id=00d2fa1cdd5b4976a0b12026821d7e2b, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:21.156604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63695520-8f0a-435e-8c92-1fd9a57877d6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:21.171647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 824/1633] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:21 2022] PUT /identity/v3/projects/9e9b531e951f4127b76b996ba3e95c8d/users/00d2fa1cdd5b4976a0b12026821d7e2b/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:21.184494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ec104-9af6-4d50-9230-debe2a11ab1e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.185137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ec104-9af6-4d50-9230-debe2a11ab1e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.185499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ec104-9af6-4d50-9230-debe2a11ab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.226599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-174ec104-9af6-4d50-9230-debe2a11ab1e None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:21.228075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-174ec104-9af6-4d50-9230-debe2a11ab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:21.234792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610e7c6-1425-4285-8de4-fa8cabea4f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:21.239610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610e7c6-1425-4285-8de4-fa8cabea4f88 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:21.255455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 810/1634] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:21.257415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001a6c2-104f-4b35-8acb-d946f63486b5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.257947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001a6c2-104f-4b35-8acb-d946f63486b5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.258412 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001a6c2-104f-4b35-8acb-d946f63486b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.297475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0001a6c2-104f-4b35-8acb-d946f63486b5 None None] MFA Rules not processed for user `00d2fa1cdd5b4976a0b12026821d7e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:21.300392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0001a6c2-104f-4b35-8acb-d946f63486b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:21.350645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 825/1635] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:21.373410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ec104-9af6-4d50-9230-debe2a11ab1e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:21.423436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 811/1636] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:21.429820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001a6c2-104f-4b35-8acb-d946f63486b5 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:21.476573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ec104-9af6-4d50-9230-debe2a11ab1e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:21.481618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9332b9b-ba7f-4755-8ea3-7fa353ac1025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:21.482646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9332b9b-ba7f-4755-8ea3-7fa353ac1025 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.492297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9332b9b-ba7f-4755-8ea3-7fa353ac1025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.492297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9332b9b-ba7f-4755-8ea3-7fa353ac1025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.499814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9332b9b-ba7f-4755-8ea3-7fa353ac1025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:21.501624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9332b9b-ba7f-4755-8ea3-7fa353ac1025 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:21.513342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001a6c2-104f-4b35-8acb-d946f63486b5 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:21.519414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42238a67-68e1-4b82-9f00-3bf8883a4358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:21.520083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42238a67-68e1-4b82-9f00-3bf8883a4358 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:21.520374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42238a67-68e1-4b82-9f00-3bf8883a4358 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:21.520805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42238a67-68e1-4b82-9f00-3bf8883a4358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:21.532663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 826/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:21.599721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42238a67-68e1-4b82-9f00-3bf8883a4358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:21.604672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42238a67-68e1-4b82-9f00-3bf8883a4358 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:21.627554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 812/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:21.667651 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:21.765395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:22.704546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9332b9b-ba7f-4755-8ea3-7fa353ac1025 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:22.728517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9332b9b-ba7f-4755-8ea3-7fa353ac1025 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:22.736041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9d260-6e33-45db-b4b9-d3296fd6481e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:22.737271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d260-6e33-45db-b4b9-d3296fd6481e service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:22.737622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d260-6e33-45db-b4b9-d3296fd6481e service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:22.738013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d260-6e33-45db-b4b9-d3296fd6481e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:22.750238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9d260-6e33-45db-b4b9-d3296fd6481e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:22.760929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9d260-6e33-45db-b4b9-d3296fd6481e service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:22.766566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 827/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:22 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:22.785631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3897e0-b946-4954-ba1f-696fc36c5615 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:22.786184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3897e0-b946-4954-ba1f-696fc36c5615 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:22.786696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3897e0-b946-4954-ba1f-696fc36c5615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:22.814875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:22.827096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5f3897e0-b946-4954-ba1f-696fc36c5615 None None] MFA Rules not processed for user `46b0e382c8f8430c9bb7640ca51a74c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:22.828483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5f3897e0-b946-4954-ba1f-696fc36c5615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:23.295989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a3ad-35a9-403a-839f-3ea3dde9250e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:23.295989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a3ad-35a9-403a-839f-3ea3dde9250e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:23.295989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a3ad-35a9-403a-839f-3ea3dde9250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:23.334150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 813/1640] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:23.337186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4ae8a3ad-35a9-403a-839f-3ea3dde9250e None None] MFA Rules not processed for user `46b0e382c8f8430c9bb7640ca51a74c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:23.337186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4ae8a3ad-35a9-403a-839f-3ea3dde9250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:23.337186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 828/1641] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:23.342808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3897e0-b946-4954-ba1f-696fc36c5615 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:23.342808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3897e0-b946-4954-ba1f-696fc36c5615 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:23.342808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8997248-5eb7-4f4d-8946-c9bf2293c3c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:23.342808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997248-5eb7-4f4d-8946-c9bf2293c3c6 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:23.346207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997248-5eb7-4f4d-8946-c9bf2293c3c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:23.346207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8997248-5eb7-4f4d-8946-c9bf2293c3c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:23.346207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8997248-5eb7-4f4d-8946-c9bf2293c3c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:23.346207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8997248-5eb7-4f4d-8946-c9bf2293c3c6 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:23.346207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 814/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:23.387631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8a3ad-35a9-403a-839f-3ea3dde9250e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:23.511904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8a3ad-35a9-403a-839f-3ea3dde9250e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:23.517461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:23.519012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:23.519766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:23.519766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] PATH_INFO: `/v3/users/45fcc5b11a8d4958babc4b48a9357119` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:23.521083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fcc5b11a8d4958babc4b48a9357119)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:23.522380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: WARNING py.warnings [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:15:23.522380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: warnings.warn(msg) May 30 12:15:23.522380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: May 30 12:15:23.523933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:23.531075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730e94-0073-4080-815c-a8ed95d68eaa None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:23.531213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730e94-0073-4080-815c-a8ed95d68eaa None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:23.531501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730e94-0073-4080-815c-a8ed95d68eaa None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:23.534155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 815/1643] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 30 12:15:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:23.550697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0a16-4cb7-4687-850e-448e55165988 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:23.550908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0a16-4cb7-4687-850e-448e55165988 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:23.551197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0a16-4cb7-4687-850e-448e55165988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:23.602299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-181f0a16-4cb7-4687-850e-448e55165988 None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:23.603766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-181f0a16-4cb7-4687-850e-448e55165988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:23.616548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 816/1644] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 30 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:23.624376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa2d9-ca8d-418f-b94c-9b638819ce22 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:23.624795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa2d9-ca8d-418f-b94c-9b638819ce22 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:23.633516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa2d9-ca8d-418f-b94c-9b638819ce22 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:23.635361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 817/1645] 10.222.0.48 () {54 vars in 912 bytes} [Mon May 30 12:15:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:23.641106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438676-5bc3-43e2-98f2-128997e25cf7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:23.641415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438676-5bc3-43e2-98f2-128997e25cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:23.641696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438676-5bc3-43e2-98f2-128997e25cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:23.661874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-22438676-5bc3-43e2-98f2-128997e25cf7 None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:23.663433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-22438676-5bc3-43e2-98f2-128997e25cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:23.682289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 818/1646] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:23.689517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22438676-5bc3-43e2-98f2-128997e25cf7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:23.701107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22438676-5bc3-43e2-98f2-128997e25cf7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:23.707145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b39d43-0f76-4830-811f-308902bda1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:23.712898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b39d43-0f76-4830-811f-308902bda1ac service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:23.712898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b39d43-0f76-4830-811f-308902bda1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:23.712898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b39d43-0f76-4830-811f-308902bda1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:23.723609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b39d43-0f76-4830-811f-308902bda1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:23.725451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b39d43-0f76-4830-811f-308902bda1ac service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:23.746250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 819/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:23.906919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fcc5b11a8d4958babc4b48a9357119'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:23.923831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fcc5b11a8d4958babc4b48a9357119'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:24.050375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fcc5b11a8d4958babc4b48a9357119'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:24.051899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fcc5b11a8d4958babc4b48a9357119'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:24.053279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee54761e-d2cb-49b3-8380-963b37167b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fcc5b11a8d4958babc4b48a9357119'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:24.131881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f8ea-369f-4692-ad1e-38080e00c5d8 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:24.132829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f8ea-369f-4692-ad1e-38080e00c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:24.133276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1f8ea-369f-4692-ad1e-38080e00c5d8 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:24.136544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 820/1648] 10.222.0.48 () {54 vars in 912 bytes} [Mon May 30 12:15:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:24.154160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3e247-8714-4d35-8f93-843b793b0703 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:24.154160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3e247-8714-4d35-8f93-843b793b0703 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:24.154387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3e247-8714-4d35-8f93-843b793b0703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:24.183228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 829/1649] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:23 2022] DELETE /identity/v3/users/45fcc5b11a8d4958babc4b48a9357119 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:24.188187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8e70-b5c3-4bf6-aa92-8f3a5eb1d64d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:24.188629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8e70-b5c3-4bf6-aa92-8f3a5eb1d64d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:24.190468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e8e70-b5c3-4bf6-aa92-8f3a5eb1d64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:24.251317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-30c3e247-8714-4d35-8f93-843b793b0703 None None] MFA Rules not processed for user `35763651d4614bf68400b5efce4113a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:24.251317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-30c3e247-8714-4d35-8f93-843b793b0703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:24.256980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a72e8e70-b5c3-4bf6-aa92-8f3a5eb1d64d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:24.258207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a72e8e70-b5c3-4bf6-aa92-8f3a5eb1d64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:24.350762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 821/1650] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:24.358665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:24.374737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 830/1651] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:24.391101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3e247-8714-4d35-8f93-843b793b0703 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:24.391101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-30c3e247-8714-4d35-8f93-843b793b0703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:24.396036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e8e70-b5c3-4bf6-aa92-8f3a5eb1d64d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:24.404883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3e247-8714-4d35-8f93-843b793b0703 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:24.420528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c425c68-585f-4b6d-91d6-2f715e051258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:24.422780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e8e70-b5c3-4bf6-aa92-8f3a5eb1d64d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:24.423228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c425c68-585f-4b6d-91d6-2f715e051258 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:24.425030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c425c68-585f-4b6d-91d6-2f715e051258 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:24.425462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c425c68-585f-4b6d-91d6-2f715e051258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:24.441442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:24.442629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:24.445870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:24.447683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:24.453708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c425c68-585f-4b6d-91d6-2f715e051258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:24.460841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:24.462445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:24.465322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c425c68-585f-4b6d-91d6-2f715e051258 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:24.476194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 831/1652] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:24.497415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 822/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:25.559299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:25.561358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:25.599191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535ebed-016c-49b4-8133-1cda23df734b service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:25.625338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:25.627121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:25.627556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:25.627976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] PATH_INFO: `/v3/projects/344d3e82481e47d2ba65b2806de7de61` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:25.630072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=344d3e82481e47d2ba65b2806de7de61)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:25.632209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:25.677387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacba275-2870-4dc5-b504-6d6efd32897a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:25.677927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacba275-2870-4dc5-b504-6d6efd32897a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:25.678038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacba275-2870-4dc5-b504-6d6efd32897a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:25.679803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 823/1654] 10.222.0.48 () {54 vars in 960 bytes} [Mon May 30 12:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:25.689228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4f38f-e62c-4ff7-9654-de0a3ec9bc7c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:25.689520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4f38f-e62c-4ff7-9654-de0a3ec9bc7c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:25.690053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4f38f-e62c-4ff7-9654-de0a3ec9bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:25.732765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-75e4f38f-e62c-4ff7-9654-de0a3ec9bc7c None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:25.746283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-75e4f38f-e62c-4ff7-9654-de0a3ec9bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:25.918365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344d3e82481e47d2ba65b2806de7de61', 'request_id': 'req-4ff24867-640a-42a5-a457-e109b36eeab0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:25.919558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:25.926195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 824/1655] 10.222.0.48 () {58 vars in 1057 bytes} [Mon May 30 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:25.937196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4f38f-e62c-4ff7-9654-de0a3ec9bc7c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:25.959393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4f38f-e62c-4ff7-9654-de0a3ec9bc7c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:26.021389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344d3e82481e47d2ba65b2806de7de61', 'request_id': 'req-4ff24867-640a-42a5-a457-e109b36eeab0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.034736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344d3e82481e47d2ba65b2806de7de61', 'request_id': 'req-4ff24867-640a-42a5-a457-e109b36eeab0'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.065656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] The token cache is being invalidate because project 344d3e82481e47d2ba65b2806de7de61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:26.065656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.068013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.076000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 832/1656] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:25 2022] DELETE /identity/v3/projects/344d3e82481e47d2ba65b2806de7de61 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:26.076998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:26.122758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:26.136326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:26.137087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:26.137472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:26.140247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:26.145836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:26.187561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:26.191974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:26.226146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 825/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:26.356751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff24867-640a-42a5-a457-e109b36eeab0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:26.385499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:26.386536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:26.386753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:26.386995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] PATH_INFO: `/v3/users/00d2fa1cdd5b4976a0b12026821d7e2b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:26.389173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d2fa1cdd5b4976a0b12026821d7e2b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:26.391421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:26.586971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:26.586971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:26.604012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330110a6-d296-46d1-a7f1-f56f88c8f8b8 service placement] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:26.618251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:26.625792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:26.625792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:26.625792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] PATH_INFO: `/v3/users/ca4253905b5d4a80ad8dcfe72f11ae34` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:26.625792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4253905b5d4a80ad8dcfe72f11ae34)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:26.625792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:26.694449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d2fa1cdd5b4976a0b12026821d7e2b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.703948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d2fa1cdd5b4976a0b12026821d7e2b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.802775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d2fa1cdd5b4976a0b12026821d7e2b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.805820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d2fa1cdd5b4976a0b12026821d7e2b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.807895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a1f2e4f7-77f1-4362-b426-788743874d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d2fa1cdd5b4976a0b12026821d7e2b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.908585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 833/1658] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:26 2022] DELETE /identity/v3/users/00d2fa1cdd5b4976a0b12026821d7e2b => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:26.981557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4253905b5d4a80ad8dcfe72f11ae34'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.998451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4253905b5d4a80ad8dcfe72f11ae34'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.999273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4253905b5d4a80ad8dcfe72f11ae34'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:26.999907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4253905b5d4a80ad8dcfe72f11ae34'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:27.113422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4253905b5d4a80ad8dcfe72f11ae34'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:27.154374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 826/1659] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:26 2022] DELETE /identity/v3/users/ca4253905b5d4a80ad8dcfe72f11ae34 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:27.168066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d7f3-d318-4bc0-a258-dd210c886e9a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:27.168066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d7f3-d318-4bc0-a258-dd210c886e9a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:27.168066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d7f3-d318-4bc0-a258-dd210c886e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:27.230966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ae18d7f3-d318-4bc0-a258-dd210c886e9a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:27.234877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ae18d7f3-d318-4bc0-a258-dd210c886e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:27.400364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 834/1660] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:27.468311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:27.470767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:27.669161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:27.706048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:27.735533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3393f-46f0-4a19-8ae2-f7278c47bf36 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:27.748112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:27.753736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:27.754257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:27.754699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:27.794997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:27.799239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:27.835642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 827/1661] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:29.014232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d7f3-d318-4bc0-a258-dd210c886e9a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:29.016359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ae18d7f3-d318-4bc0-a258-dd210c886e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:29.044069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:29.047993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:29.051150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d7f3-d318-4bc0-a258-dd210c886e9a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:29.068686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:29.072110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:29.072408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:29.072694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] PATH_INFO: `/v3/users/acba6fb144c94f10b9f4fdab0443667b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:29.077633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acba6fb144c94f10b9f4fdab0443667b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:29.082663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bdced-31d1-4458-944c-bc646bafc2d8 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:29.088116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:29.094504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:29.102402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:29.102746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:29.103037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] PATH_INFO: `/v3/projects/9e9b531e951f4127b76b996ba3e95c8d` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:29.107571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9b531e951f4127b76b996ba3e95c8d)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:29.119400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: WARNING py.warnings [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 30 12:15:29.119400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: warnings.warn(msg) May 30 12:15:29.119400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: May 30 12:15:29.120939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:29.429026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9b531e951f4127b76b996ba3e95c8d', 'request_id': 'req-7f395509-055f-4713-a928-0ffbe89e1332'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.437226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acba6fb144c94f10b9f4fdab0443667b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.451231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acba6fb144c94f10b9f4fdab0443667b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.483790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9b531e951f4127b76b996ba3e95c8d', 'request_id': 'req-7f395509-055f-4713-a928-0ffbe89e1332'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.602777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acba6fb144c94f10b9f4fdab0443667b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.603512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acba6fb144c94f10b9f4fdab0443667b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.606652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acba6fb144c94f10b9f4fdab0443667b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.648524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 835/1662] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:29 2022] DELETE /identity/v3/users/acba6fb144c94f10b9f4fdab0443667b => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:29.650601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:29.652587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:29.685455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9b531e951f4127b76b996ba3e95c8d', 'request_id': 'req-7f395509-055f-4713-a928-0ffbe89e1332'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.708767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] The token cache is being invalidate because project 9e9b531e951f4127b76b996ba3e95c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:29.709462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.711887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7f395509-055f-4713-a928-0ffbe89e1332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:29.714781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 828/1663] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:29 2022] DELETE /identity/v3/projects/9e9b531e951f4127b76b996ba3e95c8d => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:29.716611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6937c-1c34-47be-b24b-ee8848364934 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:29.717057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6937c-1c34-47be-b24b-ee8848364934 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:29.717465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6937c-1c34-47be-b24b-ee8848364934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:29.764521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-a6e6937c-1c34-47be-b24b-ee8848364934 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:29.766054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a6e6937c-1c34-47be-b24b-ee8848364934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:29.861694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6764fe-e335-4a35-9539-1d9090ff2d83 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:29.866795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:29.867682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:29.867966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:29.868245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] PATH_INFO: `/v3/projects/c14e9aa3f9c04e139f39cb44aee2faa5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:29.874961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14e9aa3f9c04e139f39cb44aee2faa5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:29.878168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:29.983022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 829/1664] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:29.984665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd16d8a-b1f6-4e78-aad4-3b0aacee57f1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:29.984963 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd16d8a-b1f6-4e78-aad4-3b0aacee57f1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:29.985247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd16d8a-b1f6-4e78-aad4-3b0aacee57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.042752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2dd16d8a-b1f6-4e78-aad4-3b0aacee57f1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:30.046677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2dd16d8a-b1f6-4e78-aad4-3b0aacee57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:30.064413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 830/1665] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:30.094755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd355-e5d6-483e-b003-88cf95f1edf7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:30.096503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd355-e5d6-483e-b003-88cf95f1edf7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:30.096930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd355-e5d6-483e-b003-88cf95f1edf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.118761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14e9aa3f9c04e139f39cb44aee2faa5', 'request_id': 'req-4675be04-d6a8-4926-b3c1-30106ae1fe31'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:30.158849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5b5bd355-e5d6-483e-b003-88cf95f1edf7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:30.160098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5b5bd355-e5d6-483e-b003-88cf95f1edf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:30.238427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14e9aa3f9c04e139f39cb44aee2faa5', 'request_id': 'req-4675be04-d6a8-4926-b3c1-30106ae1fe31'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:30.249997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14e9aa3f9c04e139f39cb44aee2faa5', 'request_id': 'req-4675be04-d6a8-4926-b3c1-30106ae1fe31'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:30.296374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] The token cache is being invalidate because project c14e9aa3f9c04e139f39cb44aee2faa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:30.296662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:30.299598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:30.307415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 836/1666] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:29 2022] DELETE /identity/v3/projects/c14e9aa3f9c04e139f39cb44aee2faa5 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:30.309112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:30.315410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:30.323733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 831/1667] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:30.326515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:30.334436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406a2ff-b695-42c0-bbf2-45fd62908166 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:30.334754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406a2ff-b695-42c0-bbf2-45fd62908166 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:30.335036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406a2ff-b695-42c0-bbf2-45fd62908166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.370565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:30.403335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7406a2ff-b695-42c0-bbf2-45fd62908166 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:30.409433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7406a2ff-b695-42c0-bbf2-45fd62908166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:30.447429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 832/1668] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:30.450279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406a2ff-b695-42c0-bbf2-45fd62908166 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:30.491396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406a2ff-b695-42c0-bbf2-45fd62908166 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:30.513136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884fb32-cf48-4671-99d6-d7e0ddc2dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:30.514132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884fb32-cf48-4671-99d6-d7e0ddc2dd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:30.516030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884fb32-cf48-4671-99d6-d7e0ddc2dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:30.516975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884fb32-cf48-4671-99d6-d7e0ddc2dd03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.522416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884fb32-cf48-4671-99d6-d7e0ddc2dd03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:30.522416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884fb32-cf48-4671-99d6-d7e0ddc2dd03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:30.531353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884fb32-cf48-4671-99d6-d7e0ddc2dd03 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:30.549067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675be04-d6a8-4926-b3c1-30106ae1fe31 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:30.557782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:30.558681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:30.558830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:30.559056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.566811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:30.572944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 833/1669] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:30.576787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6dd1-2418-4eb1-9c22-05c6a7415391 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:30.577264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6dd1-2418-4eb1-9c22-05c6a7415391 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:30.577706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6dd1-2418-4eb1-9c22-05c6a7415391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.596310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:30.598924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:30.624514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2fca6dd1-2418-4eb1-9c22-05c6a7415391 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:30.625638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 837/1670] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:30.628572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:30.634763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2fca6dd1-2418-4eb1-9c22-05c6a7415391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:30.654293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58063-cb12-4f6d-81f2-5469d80e2c5e service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:30.667397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0402-de93-4a0a-ac42-fce3fd81883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:30.671150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0402-de93-4a0a-ac42-fce3fd81883d admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:30.671531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0402-de93-4a0a-ac42-fce3fd81883d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:30.671861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0402-de93-4a0a-ac42-fce3fd81883d admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.672855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc0402-de93-4a0a-ac42-fce3fd81883d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:30.677510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc0402-de93-4a0a-ac42-fce3fd81883d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:30.682571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 834/1671] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:30.684404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6dd1-2418-4eb1-9c22-05c6a7415391 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:30.700647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6dd1-2418-4eb1-9c22-05c6a7415391 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:30.708335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:30.709684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:30.710140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:30.710597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.712614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:30.713202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:30.715177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:30.744729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 835/1672] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:30.747828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:30.769974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2e6a4-f9c5-4fbe-a5e8-c6ed1c2713b1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:30.778439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0f110-7898-4766-a779-7fe0fde858ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:30.779104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f110-7898-4766-a779-7fe0fde858ee admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:30.779445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f110-7898-4766-a779-7fe0fde858ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:30.779736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f110-7898-4766-a779-7fe0fde858ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:30.780030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 838/1673] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:30 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:30.784432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0f110-7898-4766-a779-7fe0fde858ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:30.785298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0402-de93-4a0a-ac42-fce3fd81883d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:30.786957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0f110-7898-4766-a779-7fe0fde858ee admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:30.872177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 836/1674] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:30 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:15:30.876089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0f110-7898-4766-a779-7fe0fde858ee admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:30.938525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0402-de93-4a0a-ac42-fce3fd81883d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:31.006279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0f110-7898-4766-a779-7fe0fde858ee admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:31.021757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f134c-5de4-4aed-948a-e03d6213d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:31.022820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f134c-5de4-4aed-948a-e03d6213d861 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.022820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f134c-5de4-4aed-948a-e03d6213d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.023010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f134c-5de4-4aed-948a-e03d6213d861 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.023718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f134c-5de4-4aed-948a-e03d6213d861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:31.028335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f134c-5de4-4aed-948a-e03d6213d861 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:31.096221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d8057-c387-4ae0-82c0-58f749c9bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:31.096923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d8057-c387-4ae0-82c0-58f749c9bf13 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.097262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d8057-c387-4ae0-82c0-58f749c9bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.097546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d8057-c387-4ae0-82c0-58f749c9bf13 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.098387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d8057-c387-4ae0-82c0-58f749c9bf13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:31.102537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d8057-c387-4ae0-82c0-58f749c9bf13 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:31.195866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 837/1675] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:30 2022] POST /identity/v3/users => generated 287 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:31.197515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32218a90-f4ca-4e9c-8167-c918f8aded02 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.197814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32218a90-f4ca-4e9c-8167-c918f8aded02 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.199707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32218a90-f4ca-4e9c-8167-c918f8aded02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.225273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 839/1676] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:30 2022] POST /identity/v3/users => generated 303 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:31.226303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d8057-c387-4ae0-82c0-58f749c9bf13 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:31.260606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d8057-c387-4ae0-82c0-58f749c9bf13 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:31.277929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40521ca-6f1b-4d62-a3dc-6b04ddfb9156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:31.279318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40521ca-6f1b-4d62-a3dc-6b04ddfb9156 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.281382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40521ca-6f1b-4d62-a3dc-6b04ddfb9156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.282407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40521ca-6f1b-4d62-a3dc-6b04ddfb9156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.283224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40521ca-6f1b-4d62-a3dc-6b04ddfb9156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:31.292258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40521ca-6f1b-4d62-a3dc-6b04ddfb9156 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:31.297653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-32218a90-f4ca-4e9c-8167-c918f8aded02 None None] MFA Rules not processed for user `e32767611f7d417184f55c8e7fa645b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:31.302962 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-32218a90-f4ca-4e9c-8167-c918f8aded02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:31.334748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 840/1677] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:31.337790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40521ca-6f1b-4d62-a3dc-6b04ddfb9156 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:31.377197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40521ca-6f1b-4d62-a3dc-6b04ddfb9156 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:31.412542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71672a30-3079-4b41-b47c-ebe74c859412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:31.417325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672a30-3079-4b41-b47c-ebe74c859412 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.417746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672a30-3079-4b41-b47c-ebe74c859412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.418066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672a30-3079-4b41-b47c-ebe74c859412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.423595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71672a30-3079-4b41-b47c-ebe74c859412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:31.425176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71672a30-3079-4b41-b47c-ebe74c859412 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:31.483145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 841/1678] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:31.484150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71672a30-3079-4b41-b47c-ebe74c859412 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:31.512874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71672a30-3079-4b41-b47c-ebe74c859412 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:31.534589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3112d5-34d7-4d1b-9a26-3bdeee8431e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:31.535480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3112d5-34d7-4d1b-9a26-3bdeee8431e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.537629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3112d5-34d7-4d1b-9a26-3bdeee8431e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.538417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3112d5-34d7-4d1b-9a26-3bdeee8431e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.543144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3112d5-34d7-4d1b-9a26-3bdeee8431e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:31.550549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:31.552328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3112d5-34d7-4d1b-9a26-3bdeee8431e0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:31.568274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 838/1679] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:31.568274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32218a90-f4ca-4e9c-8167-c918f8aded02 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:31.587676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 842/1680] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:31.588366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1f411-e5ba-490b-abdd-8c0564d529a7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.590043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1f411-e5ba-490b-abdd-8c0564d529a7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.590450 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1f411-e5ba-490b-abdd-8c0564d529a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.593586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32218a90-f4ca-4e9c-8167-c918f8aded02 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:31.605549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8dd12-0a50-45df-a765-a90a771867a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:31.606656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8dd12-0a50-45df-a765-a90a771867a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.606943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8dd12-0a50-45df-a765-a90a771867a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.607224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8dd12-0a50-45df-a765-a90a771867a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.613123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8dd12-0a50-45df-a765-a90a771867a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:31.613123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8dd12-0a50-45df-a765-a90a771867a1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:31.633668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 839/1681] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:31.634087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8dd12-0a50-45df-a765-a90a771867a1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:31.648891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-17b1f411-e5ba-490b-abdd-8c0564d529a7 None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:31.653848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-17b1f411-e5ba-490b-abdd-8c0564d529a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:31.660033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8dd12-0a50-45df-a765-a90a771867a1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:31.696197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b703daf-85e1-4161-88e3-3baa767651ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:31.697577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703daf-85e1-4161-88e3-3baa767651ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:31.701381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703daf-85e1-4161-88e3-3baa767651ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:31.701381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703daf-85e1-4161-88e3-3baa767651ca admin admin] PATH_INFO: `/v3/projects/c1614a8b58454affa13c75b1a32e4b54/users/130013a82abb4009a596e083b02f9029/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:31.703779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:31.737575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b703daf-85e1-4161-88e3-3baa767651ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1614a8b58454affa13c75b1a32e4b54, user_id=130013a82abb4009a596e083b02f9029, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:31.741402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b703daf-85e1-4161-88e3-3baa767651ca admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:31.807386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 843/1682] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:31.808762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1f411-e5ba-490b-abdd-8c0564d529a7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:31.810244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-17b1f411-e5ba-490b-abdd-8c0564d529a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:31.890568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 840/1683] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:31 2022] PUT /identity/v3/projects/c1614a8b58454affa13c75b1a32e4b54/users/130013a82abb4009a596e083b02f9029/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:31.901393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b703daf-85e1-4161-88e3-3baa767651ca admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:31.996029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1f411-e5ba-490b-abdd-8c0564d529a7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:32.024965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b703daf-85e1-4161-88e3-3baa767651ca admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:32.024965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d98d6f-e4cc-4cfc-93eb-330b0de294e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:32.026289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98d6f-e4cc-4cfc-93eb-330b0de294e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:32.026586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98d6f-e4cc-4cfc-93eb-330b0de294e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:32.026870 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98d6f-e4cc-4cfc-93eb-330b0de294e3 admin admin] PATH_INFO: `/v3/projects/f9b3df7d92464bb5894f9235fbb9240c/users/afae9add6a7443feb8e35da1d3aa91f6/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:32.053800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d98d6f-e4cc-4cfc-93eb-330b0de294e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b3df7d92464bb5894f9235fbb9240c, user_id=afae9add6a7443feb8e35da1d3aa91f6, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:32.057092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d98d6f-e4cc-4cfc-93eb-330b0de294e3 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:32.077853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65d109-ef52-474b-bd6f-259729526a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:32.078835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d109-ef52-474b-bd6f-259729526a92 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:32.079260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d109-ef52-474b-bd6f-259729526a92 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:32.080341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d109-ef52-474b-bd6f-259729526a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:32.126548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 841/1684] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:31 2022] PUT /identity/v3/projects/f9b3df7d92464bb5894f9235fbb9240c/users/afae9add6a7443feb8e35da1d3aa91f6/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:32.128933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95423-0d68-450a-80ef-e2bfd6b050b8 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:32.130001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95423-0d68-450a-80ef-e2bfd6b050b8 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:32.130001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca95423-0d68-450a-80ef-e2bfd6b050b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:32.156276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65d109-ef52-474b-bd6f-259729526a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:32.159639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65d109-ef52-474b-bd6f-259729526a92 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:32.171583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 844/1685] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:32.173007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64625d-58f4-4d01-a00b-e5abe116ad62 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:32.173356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64625d-58f4-4d01-a00b-e5abe116ad62 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:32.173630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64625d-58f4-4d01-a00b-e5abe116ad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:32.215331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5e64625d-58f4-4d01-a00b-e5abe116ad62 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:32.216671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5e64625d-58f4-4d01-a00b-e5abe116ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:32.227046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0ca95423-0d68-450a-80ef-e2bfd6b050b8 None None] MFA Rules not processed for user `130013a82abb4009a596e083b02f9029`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:32.229053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0ca95423-0d68-450a-80ef-e2bfd6b050b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:32.358115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 842/1686] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:32.358115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca95423-0d68-450a-80ef-e2bfd6b050b8 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:32.360055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0ca95423-0d68-450a-80ef-e2bfd6b050b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:32.371022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 845/1687] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:32.372398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64625d-58f4-4d01-a00b-e5abe116ad62 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:32.391368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5e64625d-58f4-4d01-a00b-e5abe116ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:32.554672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:32.585257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca95423-0d68-450a-80ef-e2bfd6b050b8 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:32.599458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:32.601824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:32.603005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:32.603005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:32.629942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64625d-58f4-4d01-a00b-e5abe116ad62 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:32.643313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:32.645561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:32.645848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:32.647197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:32.669015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:32.676886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:32.716672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 846/1688] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:32.717682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:32.733800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:32.734669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:32.826025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:32.833897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:32.881685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 843/1689] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:15:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:15:32.883930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:32.887629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:32.928651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf519af0-1212-499f-86a2-5518efb47c0b service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:32.947862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c7d6-1a85-4c11-a594-5ad8b84feef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:32.950247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c7d6-1a85-4c11-a594-5ad8b84feef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:32.963517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c7d6-1a85-4c11-a594-5ad8b84feef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:32.963517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c7d6-1a85-4c11-a594-5ad8b84feef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:32.967843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25b11c-9df0-4a11-ae2b-e90ae6eab0e4 service swift] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:32.995331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:32.996221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:32.996649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:32.996939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] PATH_INFO: `/v3/projects/c935cdae7d4747e7bbb8f39a5787091d` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:32.998577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c935cdae7d4747e7bbb8f39a5787091d)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:33.012812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:33.016114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6c7d6-1a85-4c11-a594-5ad8b84feef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:33.019410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6c7d6-1a85-4c11-a594-5ad8b84feef3 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:33.047048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 847/1690] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:33.150884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c7d6-1a85-4c11-a594-5ad8b84feef3 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:33.166723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c7d6-1a85-4c11-a594-5ad8b84feef3 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:33.180348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:33.181371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:33.181761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:33.182088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] PATH_INFO: `/v3/users/130013a82abb4009a596e083b02f9029` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:33.183640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130013a82abb4009a596e083b02f9029)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:33.215353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:33.270375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c935cdae7d4747e7bbb8f39a5787091d', 'request_id': 'req-aa858551-daa5-4d01-ab66-c2dc78938652'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.289474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c935cdae7d4747e7bbb8f39a5787091d', 'request_id': 'req-aa858551-daa5-4d01-ab66-c2dc78938652'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.417294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c935cdae7d4747e7bbb8f39a5787091d', 'request_id': 'req-aa858551-daa5-4d01-ab66-c2dc78938652'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.440302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] The token cache is being invalidate because project c935cdae7d4747e7bbb8f39a5787091d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:33.440776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.442672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.449345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 844/1691] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:32 2022] DELETE /identity/v3/projects/c935cdae7d4747e7bbb8f39a5787091d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:33.450696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:33.458933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:33.525010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130013a82abb4009a596e083b02f9029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.568273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:33.578710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130013a82abb4009a596e083b02f9029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.611317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858551-daa5-4d01-ab66-c2dc78938652 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:33.618502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:33.619584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:33.619876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:33.620611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] PATH_INFO: `/v3/users/8017acb0c46c41988bd880d2aa25ae56` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:33.623956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8017acb0c46c41988bd880d2aa25ae56)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:33.623956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:33.658504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:33.725383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130013a82abb4009a596e083b02f9029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.726070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130013a82abb4009a596e083b02f9029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.727657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6b9245e2-0e5a-4ee4-a10b-2c427758ade5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130013a82abb4009a596e083b02f9029'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.832172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 848/1692] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:33 2022] DELETE /identity/v3/users/130013a82abb4009a596e083b02f9029 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:33.840270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7709-ec86-4b46-8b47-f8dd54e095dc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:33.840270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7709-ec86-4b46-8b47-f8dd54e095dc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:33.840270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7709-ec86-4b46-8b47-f8dd54e095dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:33.875681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8017acb0c46c41988bd880d2aa25ae56'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.893010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8017acb0c46c41988bd880d2aa25ae56'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.893833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8017acb0c46c41988bd880d2aa25ae56'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.895638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8017acb0c46c41988bd880d2aa25ae56'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:33.903451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ac1f7709-ec86-4b46-8b47-f8dd54e095dc None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:33.904562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ac1f7709-ec86-4b46-8b47-f8dd54e095dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:33.952549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8017acb0c46c41988bd880d2aa25ae56'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:34.025548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 845/1693] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:33 2022] DELETE /identity/v3/users/8017acb0c46c41988bd880d2aa25ae56 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:34.106718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:34.175307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 849/1694] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:34.338307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:34.340104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:34.599599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070311a9-a1d8-44f8-8297-ea6c6aae7dd1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:34.599599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97208f1-71c1-4fd3-b39d-32d18d18e466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:34.599599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97208f1-71c1-4fd3-b39d-32d18d18e466 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:34.599599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97208f1-71c1-4fd3-b39d-32d18d18e466 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:34.601434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97208f1-71c1-4fd3-b39d-32d18d18e466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:34.622348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97208f1-71c1-4fd3-b39d-32d18d18e466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:34.624129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97208f1-71c1-4fd3-b39d-32d18d18e466 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:34.639370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 846/1695] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:34.800223 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce87e-f811-422e-b6d9-8f96413341ee None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:34.800668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce87e-f811-422e-b6d9-8f96413341ee None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:34.807178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce87e-f811-422e-b6d9-8f96413341ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:34.846383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e5cce87e-f811-422e-b6d9-8f96413341ee None None] MFA Rules not processed for user `35763651d4614bf68400b5efce4113a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:34.847615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e5cce87e-f811-422e-b6d9-8f96413341ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:34.866675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 850/1696] 10.222.0.39 () {58 vars in 1015 bytes} [Mon May 30 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:34.968060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97208f1-71c1-4fd3-b39d-32d18d18e466 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:34.980582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97208f1-71c1-4fd3-b39d-32d18d18e466 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:34.995891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef5b5c-997e-4874-9453-a5ddaffe01a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:34.999510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5b5c-997e-4874-9453-a5ddaffe01a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:34.999700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5b5c-997e-4874-9453-a5ddaffe01a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:35.000541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef5b5c-997e-4874-9453-a5ddaffe01a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:35.031922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef5b5c-997e-4874-9453-a5ddaffe01a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:35.035234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef5b5c-997e-4874-9453-a5ddaffe01a6 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:35.090832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 847/1697] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:35.361684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce87e-f811-422e-b6d9-8f96413341ee None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:35.363400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e5cce87e-f811-422e-b6d9-8f96413341ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:35.387167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce87e-f811-422e-b6d9-8f96413341ee None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:35.411914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:35.413808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:35.415577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:35.416603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] PATH_INFO: `/v3/projects/01c25af0323941c4825f94f2bf3e2c51` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:35.422160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c25af0323941c4825f94f2bf3e2c51)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:35.428791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:35.681642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c25af0323941c4825f94f2bf3e2c51', 'request_id': 'req-f2cb2967-64d8-40d9-ad02-a177cfab10b3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.798810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c25af0323941c4825f94f2bf3e2c51', 'request_id': 'req-f2cb2967-64d8-40d9-ad02-a177cfab10b3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.810721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c25af0323941c4825f94f2bf3e2c51', 'request_id': 'req-f2cb2967-64d8-40d9-ad02-a177cfab10b3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.846498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] The token cache is being invalidate because project 01c25af0323941c4825f94f2bf3e2c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:35.846498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.846498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2cb2967-64d8-40d9-ad02-a177cfab10b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:35.846498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 851/1698] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:35 2022] DELETE /identity/v3/projects/01c25af0323941c4825f94f2bf3e2c51 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:35.846890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca0b5d-c02c-4b64-8439-9135936d8326 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:35.846890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca0b5d-c02c-4b64-8439-9135936d8326 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:35.846890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca0b5d-c02c-4b64-8439-9135936d8326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:35.888907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-47ca0b5d-c02c-4b64-8439-9135936d8326 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:35.890154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-47ca0b5d-c02c-4b64-8439-9135936d8326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:36.035029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:36.113996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 848/1699] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:36.121638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9f37-8907-4fc7-a641-372e33f6ce09 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.122165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9f37-8907-4fc7-a641-372e33f6ce09 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.122272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9f37-8907-4fc7-a641-372e33f6ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.155496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-53ba9f37-8907-4fc7-a641-372e33f6ce09 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:36.156470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-53ba9f37-8907-4fc7-a641-372e33f6ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:36.248949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca0b5d-c02c-4b64-8439-9135936d8326 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.256795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 852/1700] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:36.260853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca0b5d-c02c-4b64-8439-9135936d8326 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.267040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.269848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.271004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.271618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.274040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:36.276051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.278146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.338250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 849/1701] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:36.344174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9f37-8907-4fc7-a641-372e33f6ce09 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.377294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9f37-8907-4fc7-a641-372e33f6ce09 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.406156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01802881-c99c-48e3-a8b0-e29ceda39330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.406894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802881-c99c-48e3-a8b0-e29ceda39330 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.407121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802881-c99c-48e3-a8b0-e29ceda39330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.407922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802881-c99c-48e3-a8b0-e29ceda39330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.412503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01802881-c99c-48e3-a8b0-e29ceda39330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.417793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01802881-c99c-48e3-a8b0-e29ceda39330 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.557074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 853/1702] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:36.557389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.582642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f89b4-b2b0-4482-a7eb-aea3c97dd77a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:36.824549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487f85e-b6d2-4443-8493-f0a109ee7d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:36.826894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f85e-b6d2-4443-8493-f0a109ee7d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:36.831906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f85e-b6d2-4443-8493-f0a109ee7d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:36.831906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f85e-b6d2-4443-8493-f0a109ee7d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:36.831906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487f85e-b6d2-4443-8493-f0a109ee7d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:36.831906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487f85e-b6d2-4443-8493-f0a109ee7d79 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:36.966199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 850/1703] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:36 2022] POST /identity/v3/users => generated 291 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:15:36.967165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01802881-c99c-48e3-a8b0-e29ceda39330 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:36.984481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01802881-c99c-48e3-a8b0-e29ceda39330 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:37.000008 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c39bfd-dad6-4994-83b1-9f8088fcc188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:37.001569 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c39bfd-dad6-4994-83b1-9f8088fcc188 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:37.002045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c39bfd-dad6-4994-83b1-9f8088fcc188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:37.002633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c39bfd-dad6-4994-83b1-9f8088fcc188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:37.004232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c39bfd-dad6-4994-83b1-9f8088fcc188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:37.006081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c39bfd-dad6-4994-83b1-9f8088fcc188 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:37.028506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 854/1704] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:37.036563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487f85e-b6d2-4443-8493-f0a109ee7d79 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:37.093132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487f85e-b6d2-4443-8493-f0a109ee7d79 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:37.125386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96f04e-ae60-44ec-8d08-cb6628ba942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:37.130464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96f04e-ae60-44ec-8d08-cb6628ba942e admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:37.138265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96f04e-ae60-44ec-8d08-cb6628ba942e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:37.140275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96f04e-ae60-44ec-8d08-cb6628ba942e admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:37.143722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96f04e-ae60-44ec-8d08-cb6628ba942e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:37.149495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96f04e-ae60-44ec-8d08-cb6628ba942e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:37.208315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 851/1705] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:37.212288 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c39bfd-dad6-4994-83b1-9f8088fcc188 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:37.244204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c39bfd-dad6-4994-83b1-9f8088fcc188 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:37.263924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf6c75-7999-4432-b09c-f499a7ee8add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:37.265211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf6c75-7999-4432-b09c-f499a7ee8add admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:37.266011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf6c75-7999-4432-b09c-f499a7ee8add admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:37.266512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf6c75-7999-4432-b09c-f499a7ee8add admin admin] PATH_INFO: `/v3/projects/f1bc01a252fa4c288e278da850c9ea4d/users/617af39c6a4b46f58dc7a8bb748db278/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:37.338026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf6c75-7999-4432-b09c-f499a7ee8add admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bc01a252fa4c288e278da850c9ea4d, user_id=617af39c6a4b46f58dc7a8bb748db278, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:37.344317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf6c75-7999-4432-b09c-f499a7ee8add admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:37.428722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 855/1706] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:37 2022] PUT /identity/v3/projects/f1bc01a252fa4c288e278da850c9ea4d/users/617af39c6a4b46f58dc7a8bb748db278/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:37.444709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d01a-4da7-4894-b0c6-8e69e1dd12d3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:37.445015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d01a-4da7-4894-b0c6-8e69e1dd12d3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:37.445420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770d01a-4da7-4894-b0c6-8e69e1dd12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:37.528381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8770d01a-4da7-4894-b0c6-8e69e1dd12d3 None None] MFA Rules not processed for user `617af39c6a4b46f58dc7a8bb748db278`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:37.532802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8770d01a-4da7-4894-b0c6-8e69e1dd12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:37.770907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 852/1707] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:37.772506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf6c75-7999-4432-b09c-f499a7ee8add admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:37.886023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf6c75-7999-4432-b09c-f499a7ee8add admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:37.893264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bd02c-6b51-40de-8faf-433b2f0bda60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:37.894444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bd02c-6b51-40de-8faf-433b2f0bda60 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:37.894894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bd02c-6b51-40de-8faf-433b2f0bda60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:37.895329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bd02c-6b51-40de-8faf-433b2f0bda60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:37.896309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bd02c-6b51-40de-8faf-433b2f0bda60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:37.899386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bd02c-6b51-40de-8faf-433b2f0bda60 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:37.916773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:38.038217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d01a-4da7-4894-b0c6-8e69e1dd12d3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:38.043340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8770d01a-4da7-4894-b0c6-8e69e1dd12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:38.094168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 856/1708] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:37 2022] POST /identity/v3/projects => generated 381 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:38.099987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bd02c-6b51-40de-8faf-433b2f0bda60 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:38.123076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770d01a-4da7-4894-b0c6-8e69e1dd12d3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:38.283780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:38.388039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bd02c-6b51-40de-8faf-433b2f0bda60 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:38.396791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a792f-e944-4f9f-bee0-9a37a11c7c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:38.397463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:38.397579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a792f-e944-4f9f-bee0-9a37a11c7c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:38.397773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a792f-e944-4f9f-bee0-9a37a11c7c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:38.398117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a792f-e944-4f9f-bee0-9a37a11c7c31 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:38.400801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a792f-e944-4f9f-bee0-9a37a11c7c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:38.405713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:38.406033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:38.406329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] PATH_INFO: `/v3/projects/c1614a8b58454affa13c75b1a32e4b54` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:38.410287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1614a8b58454affa13c75b1a32e4b54)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:38.413506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:38.421309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a792f-e944-4f9f-bee0-9a37a11c7c31 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:38.563873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 857/1709] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:38 2022] POST /identity/v3/users => generated 297 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:38.565013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a792f-e944-4f9f-bee0-9a37a11c7c31 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:38.595519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a792f-e944-4f9f-bee0-9a37a11c7c31 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:38.599067 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1614a8b58454affa13c75b1a32e4b54', 'request_id': 'req-11602a09-9b3d-47e4-8ba0-43584552ab4a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:38.649203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1614a8b58454affa13c75b1a32e4b54', 'request_id': 'req-11602a09-9b3d-47e4-8ba0-43584552ab4a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:38.724620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1614a8b58454affa13c75b1a32e4b54', 'request_id': 'req-11602a09-9b3d-47e4-8ba0-43584552ab4a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:38.747301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] The token cache is being invalidate because project c1614a8b58454affa13c75b1a32e4b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:38.747607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:38.752821 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-11602a09-9b3d-47e4-8ba0-43584552ab4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:38.773380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:38.774263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 853/1710] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:38 2022] DELETE /identity/v3/projects/c1614a8b58454affa13c75b1a32e4b54 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:38.775354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:38.775927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:38.776313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:38.777192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:38.779826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:38.780739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a782-753d-4b45-8ec7-895475eb3458 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:38.781483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a782-753d-4b45-8ec7-895475eb3458 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:38.781924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a782-753d-4b45-8ec7-895475eb3458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:38.814687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c2f0a782-753d-4b45-8ec7-895475eb3458 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:38.814687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c2f0a782-753d-4b45-8ec7-895475eb3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:38.843322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 854/1711] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:38.854560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7663bbc-b127-495f-8021-a9fde6efd6cc None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:38.854943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7663bbc-b127-495f-8021-a9fde6efd6cc None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:38.855232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7663bbc-b127-495f-8021-a9fde6efd6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:38.869585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 858/1712] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:38.871922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:38.875731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:38.912281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-e7663bbc-b127-495f-8021-a9fde6efd6cc None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:38.913597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e7663bbc-b127-495f-8021-a9fde6efd6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:38.942273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f9d07-77fd-45ca-95ef-8da6d4db8243 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:38.952583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de90fe2-c8b3-43ca-a389-22b27bf1cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:38.956425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 855/1713] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:38.957613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de90fe2-c8b3-43ca-a389-22b27bf1cb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:38.958037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de90fe2-c8b3-43ca-a389-22b27bf1cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:38.958428 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de90fe2-c8b3-43ca-a389-22b27bf1cb0c admin admin] PATH_INFO: `/v3/projects/2a5116292e724e43a8c539c4788294d2/users/c74e5c406ff2421199ee10d2d50e4abc/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:38.960746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7663bbc-b127-495f-8021-a9fde6efd6cc None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:38.999069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7663bbc-b127-495f-8021-a9fde6efd6cc None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:39.000821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de90fe2-c8b3-43ca-a389-22b27bf1cb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5116292e724e43a8c539c4788294d2, user_id=c74e5c406ff2421199ee10d2d50e4abc, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:39.004584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de90fe2-c8b3-43ca-a389-22b27bf1cb0c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:39.010787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:39.011489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.011774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.012052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.012791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:39.013098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:39.014812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:39.044439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 856/1714] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:39.046175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:39.057010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb9aa8-281f-47a3-ae07-82c756564a7f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:39.085262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae1878-d1fa-4cdc-a272-2556cf55d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:39.086403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae1878-d1fa-4cdc-a272-2556cf55d15f admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.086831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae1878-d1fa-4cdc-a272-2556cf55d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.087402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae1878-d1fa-4cdc-a272-2556cf55d15f admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.088254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae1878-d1fa-4cdc-a272-2556cf55d15f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:39.091679 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 859/1715] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:38 2022] PUT /identity/v3/projects/2a5116292e724e43a8c539c4788294d2/users/c74e5c406ff2421199ee10d2d50e4abc/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:39.093988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae1878-d1fa-4cdc-a272-2556cf55d15f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:39.095705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de90fe2-c8b3-43ca-a389-22b27bf1cb0c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:39.240333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 857/1716] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:39 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:39.244345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae1878-d1fa-4cdc-a272-2556cf55d15f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:39.247113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:39.271556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de90fe2-c8b3-43ca-a389-22b27bf1cb0c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:39.460879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae1878-d1fa-4cdc-a272-2556cf55d15f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:39.475455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e096a5-4b6f-4b63-b2de-e743b9ef6db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:39.476216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e096a5-4b6f-4b63-b2de-e743b9ef6db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.476501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e096a5-4b6f-4b63-b2de-e743b9ef6db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.478218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e096a5-4b6f-4b63-b2de-e743b9ef6db7 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.478218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e096a5-4b6f-4b63-b2de-e743b9ef6db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:39.484511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e096a5-4b6f-4b63-b2de-e743b9ef6db7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:39.486984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce00f8e-6b46-4863-8f06-51ceeb34aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:39.488168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce00f8e-6b46-4863-8f06-51ceeb34aee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.488669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce00f8e-6b46-4863-8f06-51ceeb34aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.489256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce00f8e-6b46-4863-8f06-51ceeb34aee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.490617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce00f8e-6b46-4863-8f06-51ceeb34aee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:39.507052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce00f8e-6b46-4863-8f06-51ceeb34aee7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:39.522395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 860/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:15:39.524052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1918-e9b8-40da-9dbe-46e06e7e95ed None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.524556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1918-e9b8-40da-9dbe-46e06e7e95ed None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.525062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1918-e9b8-40da-9dbe-46e06e7e95ed None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.531310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 861/1718] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:15:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:39.532762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d1918-e9b8-40da-9dbe-46e06e7e95ed None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:39.561564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d1918-e9b8-40da-9dbe-46e06e7e95ed None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:39.581175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd23e0-daeb-4793-8b3b-0910ab79072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:39.586137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd23e0-daeb-4793-8b3b-0910ab79072b admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.586631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd23e0-daeb-4793-8b3b-0910ab79072b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.588956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd23e0-daeb-4793-8b3b-0910ab79072b admin admin] PATH_INFO: `/v3/projects/2a5116292e724e43a8c539c4788294d2/users/c74e5c406ff2421199ee10d2d50e4abc/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.596000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd23e0-daeb-4793-8b3b-0910ab79072b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5116292e724e43a8c539c4788294d2, user_id=c74e5c406ff2421199ee10d2d50e4abc, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:39.600904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd23e0-daeb-4793-8b3b-0910ab79072b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:39.613038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 858/1719] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:39 2022] POST /identity/v3/users => generated 283 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:39.617777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b296d1-423f-48b7-8548-142ca83d3ecc None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.617998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b296d1-423f-48b7-8548-142ca83d3ecc None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.618286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b296d1-423f-48b7-8548-142ca83d3ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.627008 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 862/1720] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:39 2022] PUT /identity/v3/projects/2a5116292e724e43a8c539c4788294d2/users/c74e5c406ff2421199ee10d2d50e4abc/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:39.628207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd23e0-daeb-4793-8b3b-0910ab79072b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:39.656163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:39.672066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-e1b296d1-423f-48b7-8548-142ca83d3ecc None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:39.674430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e1b296d1-423f-48b7-8548-142ca83d3ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:39.807732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd23e0-daeb-4793-8b3b-0910ab79072b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:39.828430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4203116-142e-4947-b42b-f8de3fd5b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:39.829376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203116-142e-4947-b42b-f8de3fd5b347 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.834826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203116-142e-4947-b42b-f8de3fd5b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.834826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203116-142e-4947-b42b-f8de3fd5b347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.834826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4203116-142e-4947-b42b-f8de3fd5b347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:39.834826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4203116-142e-4947-b42b-f8de3fd5b347 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:39.895121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 863/1721] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:39.904483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb4f14-3f9c-442e-abc4-0964951f5ae0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:39.909550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb4f14-3f9c-442e-abc4-0964951f5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:39.909550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb4f14-3f9c-442e-abc4-0964951f5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:39.943796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 859/1722] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:15:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:39.951434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b296d1-423f-48b7-8548-142ca83d3ecc None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:39.984957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b296d1-423f-48b7-8548-142ca83d3ecc None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:40.003191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:40.007037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:40.007037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:40.007037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:40.007037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:40.010309 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:40.019411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1afb4f14-3f9c-442e-abc4-0964951f5ae0 None None] MFA Rules not processed for user `c74e5c406ff2421199ee10d2d50e4abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:40.020893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1afb4f14-3f9c-442e-abc4-0964951f5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:40.046396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 860/1723] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:40.048817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:40.053345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:40.109165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1a5d-2046-445b-8049-23422cdca741 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:40.137571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fdc0-77d6-4f22-beee-37f4861b7674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:40.138431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fdc0-77d6-4f22-beee-37f4861b7674 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:40.138825 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fdc0-77d6-4f22-beee-37f4861b7674 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:40.138984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fdc0-77d6-4f22-beee-37f4861b7674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:40.195833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fdc0-77d6-4f22-beee-37f4861b7674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:40.201268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fdc0-77d6-4f22-beee-37f4861b7674 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:40.253374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 861/1724] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:40.263824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 864/1725] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:40.267353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fdc0-77d6-4f22-beee-37f4861b7674 service nova] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:40.275709 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb4f14-3f9c-442e-abc4-0964951f5ae0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:40.278372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1afb4f14-3f9c-442e-abc4-0964951f5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:40.288010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:40.319753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fdc0-77d6-4f22-beee-37f4861b7674 service nova] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:40.344816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae3238-a294-40ac-899b-4b431acf80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:40.358690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3238-a294-40ac-899b-4b431acf80df admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:40.358690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3238-a294-40ac-899b-4b431acf80df admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:40.358690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3238-a294-40ac-899b-4b431acf80df admin admin] PATH_INFO: `/v3/projects/57241f6ed47545b7ba4fbb66e8767f16/users/bff058b650d044d1afaf1b52cf57355f/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:40.407706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae3238-a294-40ac-899b-4b431acf80df admin admin] RBAC: Authorizing `identity:create_grant(project_id=57241f6ed47545b7ba4fbb66e8767f16, user_id=bff058b650d044d1afaf1b52cf57355f, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:40.413183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae3238-a294-40ac-899b-4b431acf80df admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:40.451281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb4f14-3f9c-442e-abc4-0964951f5ae0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:40.461714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac83acf-e3e5-4481-82fe-8fb76b845c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:40.461714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83acf-e3e5-4481-82fe-8fb76b845c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:40.461714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83acf-e3e5-4481-82fe-8fb76b845c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:40.461714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83acf-e3e5-4481-82fe-8fb76b845c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:40.481526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac83acf-e3e5-4481-82fe-8fb76b845c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:40.486476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac83acf-e3e5-4481-82fe-8fb76b845c7a service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:40.501938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 862/1726] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:40 2022] PUT /identity/v3/projects/57241f6ed47545b7ba4fbb66e8767f16/users/bff058b650d044d1afaf1b52cf57355f/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:40.511690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 865/1727] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:40.512844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39093-14d6-429a-b05e-ab09184c0eb0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:40.513313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39093-14d6-429a-b05e-ab09184c0eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:40.513737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39093-14d6-429a-b05e-ab09184c0eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:40.588187 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-fbb39093-14d6-429a-b05e-ab09184c0eb0 None None] MFA Rules not processed for user `bff058b650d044d1afaf1b52cf57355f`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:40.590014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-fbb39093-14d6-429a-b05e-ab09184c0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:40.827767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 863/1728] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:40.839609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac83acf-e3e5-4481-82fe-8fb76b845c7a service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:40.854759 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac83acf-e3e5-4481-82fe-8fb76b845c7a service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:41.072576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb049-7d0f-446d-b925-2cdf86a25ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:41.074760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb049-7d0f-446d-b925-2cdf86a25ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:41.077732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb049-7d0f-446d-b925-2cdf86a25ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:41.078271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb049-7d0f-446d-b925-2cdf86a25ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:41.090708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb049-7d0f-446d-b925-2cdf86a25ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:41.097274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb049-7d0f-446d-b925-2cdf86a25ce9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:41.302036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 866/1729] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:40 2022] POST /identity/v3/projects => generated 363 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:41.305847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39093-14d6-429a-b05e-ab09184c0eb0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:41.342282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39093-14d6-429a-b05e-ab09184c0eb0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:41.473182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:41.566164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96fb36-1fcf-4a8f-ac55-ee273f3a71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:41.566908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96fb36-1fcf-4a8f-ac55-ee273f3a71d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:41.567336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96fb36-1fcf-4a8f-ac55-ee273f3a71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:41.567537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96fb36-1fcf-4a8f-ac55-ee273f3a71d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:41.568185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96fb36-1fcf-4a8f-ac55-ee273f3a71d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:41.570245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96fb36-1fcf-4a8f-ac55-ee273f3a71d5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:41.578689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb049-7d0f-446d-b925-2cdf86a25ce9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:41.604912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb049-7d0f-446d-b925-2cdf86a25ce9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:41.620888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:41.632523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:41.632939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:41.633353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] PATH_INFO: `/v3/users/617af39c6a4b46f58dc7a8bb748db278` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:41.639512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617af39c6a4b46f58dc7a8bb748db278)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:41.649240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:41.683962 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 864/1730] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:41 2022] POST /identity/v3/users => generated 288 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:41.689083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96fb36-1fcf-4a8f-ac55-ee273f3a71d5 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:41.723234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96fb36-1fcf-4a8f-ac55-ee273f3a71d5 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:41.748633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff35a-c2be-4f12-8858-497e0e9672e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:41.750235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff35a-c2be-4f12-8858-497e0e9672e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:41.751632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff35a-c2be-4f12-8858-497e0e9672e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:41.752138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff35a-c2be-4f12-8858-497e0e9672e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:41.753417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ff35a-c2be-4f12-8858-497e0e9672e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:41.756076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ff35a-c2be-4f12-8858-497e0e9672e3 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:41.775192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 865/1731] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:15:41.782481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff35a-c2be-4f12-8858-497e0e9672e3 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:41.811790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff35a-c2be-4f12-8858-497e0e9672e3 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:41.829258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1688-3d5e-494a-95ff-4dc4bca4bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:41.831407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1688-3d5e-494a-95ff-4dc4bca4bcee admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:41.832312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1688-3d5e-494a-95ff-4dc4bca4bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:41.833674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1688-3d5e-494a-95ff-4dc4bca4bcee admin admin] PATH_INFO: `/v3/projects/9c23ebea4ab7447bb12dd4a856db9cac/users/b12e294f8eb443f4956d5bba2ec63176/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:41.871574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a1688-3d5e-494a-95ff-4dc4bca4bcee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c23ebea4ab7447bb12dd4a856db9cac, user_id=b12e294f8eb443f4956d5bba2ec63176, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:41.875033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a1688-3d5e-494a-95ff-4dc4bca4bcee admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:41.903854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617af39c6a4b46f58dc7a8bb748db278'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:41.924557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617af39c6a4b46f58dc7a8bb748db278'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:41.966015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 866/1732] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:41 2022] PUT /identity/v3/projects/9c23ebea4ab7447bb12dd4a856db9cac/users/b12e294f8eb443f4956d5bba2ec63176/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:41.970780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1688-3d5e-494a-95ff-4dc4bca4bcee admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:42.009452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617af39c6a4b46f58dc7a8bb748db278'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:42.010404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617af39c6a4b46f58dc7a8bb748db278'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:42.011207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-10dba923-6a0e-46dc-864d-0a52eefcd1b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617af39c6a4b46f58dc7a8bb748db278'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:42.055294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 867/1733] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:41 2022] DELETE /identity/v3/users/617af39c6a4b46f58dc7a8bb748db278 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:42.060290 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3b40-4265-4299-a2c6-2c2c1d78306c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.060639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3b40-4265-4299-a2c6-2c2c1d78306c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.060931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e3b40-4265-4299-a2c6-2c2c1d78306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.063056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1688-3d5e-494a-95ff-4dc4bca4bcee admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:42.078418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:42.103150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e15e3b40-4265-4299-a2c6-2c2c1d78306c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:42.104607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e15e3b40-4265-4299-a2c6-2c2c1d78306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:42.214135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:42.215010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.215387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.215675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.216447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:42.224783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:42.272773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 867/1734] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:15:42.276524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:42.283430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:42.302061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 868/1735] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:15:42.322633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001ee2-06e6-4e3b-aec5-f4f49c842d77 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:42.335639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ee0b1-3624-44e9-9327-2374f8ce451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:42.336568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ee0b1-3624-44e9-9327-2374f8ce451c admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.336861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ee0b1-3624-44e9-9327-2374f8ce451c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.337146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ee0b1-3624-44e9-9327-2374f8ce451c admin admin] PATH_INFO: `/v3/projects/9c23ebea4ab7447bb12dd4a856db9cac/users/b12e294f8eb443f4956d5bba2ec63176/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.345479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ee0b1-3624-44e9-9327-2374f8ce451c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c23ebea4ab7447bb12dd4a856db9cac, user_id=b12e294f8eb443f4956d5bba2ec63176, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:42.345648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3b40-4265-4299-a2c6-2c2c1d78306c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:42.345648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e15e3b40-4265-4299-a2c6-2c2c1d78306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:42.345809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ee0b1-3624-44e9-9327-2374f8ce451c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:42.383528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 868/1736] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:42 2022] PUT /identity/v3/projects/9c23ebea4ab7447bb12dd4a856db9cac/users/b12e294f8eb443f4956d5bba2ec63176/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:42.395126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bff0fd-e15d-4696-8b97-8c1e304a699f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.402829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bff0fd-e15d-4696-8b97-8c1e304a699f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.403330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bff0fd-e15d-4696-8b97-8c1e304a699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.469463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e3b40-4265-4299-a2c6-2c2c1d78306c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:42.496280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-47bff0fd-e15d-4696-8b97-8c1e304a699f None None] MFA Rules not processed for user `b12e294f8eb443f4956d5bba2ec63176`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:42.497718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-47bff0fd-e15d-4696-8b97-8c1e304a699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:42.525953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:42.559068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:42.560784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.561225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.562683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.683949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:42.685806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:42.728949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 869/1737] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:42.740591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 869/1738] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:42.754952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:42.757159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:42.794900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:42.942457 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06544c96-033e-4fa2-bd48-aaf5985aa034 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:42.953123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e61c9-1c79-40ac-ac2d-91746fa40626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:42.957328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e61c9-1c79-40ac-ac2d-91746fa40626 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:42.959544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e61c9-1c79-40ac-ac2d-91746fa40626 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:42.959900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e61c9-1c79-40ac-ac2d-91746fa40626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:42.977710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e61c9-1c79-40ac-ac2d-91746fa40626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:42.979284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e61c9-1c79-40ac-ac2d-91746fa40626 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:42.992004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 870/1739] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:43.104974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4118-0158-418f-af7b-094bb50c67d2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:43.105453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4118-0158-418f-af7b-094bb50c67d2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:43.105715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4118-0158-418f-af7b-094bb50c67d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:43.197348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5ecb4118-0158-418f-af7b-094bb50c67d2 None None] MFA Rules not processed for user `00e99aa4e6c14e7bafa57df2c867e9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:43.204704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5ecb4118-0158-418f-af7b-094bb50c67d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.366664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 870/1740] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:43.376943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8c74d-13fd-4236-8aef-0fb3eae2daad None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:43.377910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8c74d-13fd-4236-8aef-0fb3eae2daad None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:43.378492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8c74d-13fd-4236-8aef-0fb3eae2daad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:43.395185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4118-0158-418f-af7b-094bb50c67d2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:43.397099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5ecb4118-0158-418f-af7b-094bb50c67d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.434297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4118-0158-418f-af7b-094bb50c67d2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:43.462593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:43.464813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:43.465110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:43.465401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] PATH_INFO: `/v3/projects/f1bc01a252fa4c288e278da850c9ea4d` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:43.476963 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d8c8c74d-13fd-4236-8aef-0fb3eae2daad None None] MFA Rules not processed for user `00e99aa4e6c14e7bafa57df2c867e9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:43.478420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d8c8c74d-13fd-4236-8aef-0fb3eae2daad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.485668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bc01a252fa4c288e278da850c9ea4d)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:43.489774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:43.510072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 871/1741] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:43.521434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8c74d-13fd-4236-8aef-0fb3eae2daad None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:43.525815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d8c8c74d-13fd-4236-8aef-0fb3eae2daad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.746784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bc01a252fa4c288e278da850c9ea4d', 'request_id': 'req-3af955c1-2315-4f66-9c86-fc97fd69096f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.759031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8c74d-13fd-4236-8aef-0fb3eae2daad None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:43.765999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bc01a252fa4c288e278da850c9ea4d', 'request_id': 'req-3af955c1-2315-4f66-9c86-fc97fd69096f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.855384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bc01a252fa4c288e278da850c9ea4d', 'request_id': 'req-3af955c1-2315-4f66-9c86-fc97fd69096f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.899957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] The token cache is being invalidate because project f1bc01a252fa4c288e278da850c9ea4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:43.901085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.904833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:43.912420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 871/1742] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:43 2022] DELETE /identity/v3/projects/f1bc01a252fa4c288e278da850c9ea4d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:43.921626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:43.924223 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.941307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bbcf1-ad7f-4931-9d7d-118a877312a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:43.942382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbcf1-ad7f-4931-9d7d-118a877312a3 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:43.942816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbcf1-ad7f-4931-9d7d-118a877312a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:43.943291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbcf1-ad7f-4931-9d7d-118a877312a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:43.946161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f90bbcf1-ad7f-4931-9d7d-118a877312a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:43.978237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:44.005092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:44.024534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bbcf1-ad7f-4931-9d7d-118a877312a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.036755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bbcf1-ad7f-4931-9d7d-118a877312a3 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.067202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 872/1743] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:44.068783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aed9-41fb-4d13-80be-586d5aabbf41 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.069049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aed9-41fb-4d13-80be-586d5aabbf41 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.069336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aed9-41fb-4d13-80be-586d5aabbf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.082052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af955c1-2315-4f66-9c86-fc97fd69096f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.087549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.088646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.089513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.089808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] PATH_INFO: `/v3/users/c74e5c406ff2421199ee10d2d50e4abc` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.091834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74e5c406ff2421199ee10d2d50e4abc)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.112007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.131463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e661aed9-41fb-4d13-80be-586d5aabbf41 None None] MFA Rules not processed for user `afae9add6a7443feb8e35da1d3aa91f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:44.132722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e661aed9-41fb-4d13-80be-586d5aabbf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:44.321266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74e5c406ff2421199ee10d2d50e4abc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:44.348608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74e5c406ff2421199ee10d2d50e4abc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:44.350937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 873/1744] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:44.351979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74e5c406ff2421199ee10d2d50e4abc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:44.355534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aed9-41fb-4d13-80be-586d5aabbf41 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.355785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74e5c406ff2421199ee10d2d50e4abc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:44.360555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e661aed9-41fb-4d13-80be-586d5aabbf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:44.393689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aed9-41fb-4d13-80be-586d5aabbf41 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.405389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:44.406571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:44.407619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:44.410277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:44.411270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:44.417549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:44.466354 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74e5c406ff2421199ee10d2d50e4abc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:44.500101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 872/1745] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:43 2022] DELETE /identity/v3/users/c74e5c406ff2421199ee10d2d50e4abc => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:44.569448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 874/1746] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/projects => generated 405 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:44.577780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.582119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:44.782887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:44.785649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:44.886416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0fe76-8c6b-45fb-b4be-cd844842cff9 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:44.979640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683501-1d45-4fd0-b2e8-4feddae4b054 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:45.002065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.002942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.003195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.003493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] PATH_INFO: `/v3/users/bff058b650d044d1afaf1b52cf57355f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.006113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff058b650d044d1afaf1b52cf57355f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.010470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:45.024671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:45.055971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463785e3-c374-4e41-8fa0-d56b5c1c264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.056863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463785e3-c374-4e41-8fa0-d56b5c1c264d admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.057242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463785e3-c374-4e41-8fa0-d56b5c1c264d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.057791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463785e3-c374-4e41-8fa0-d56b5c1c264d admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.058768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463785e3-c374-4e41-8fa0-d56b5c1c264d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.065153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463785e3-c374-4e41-8fa0-d56b5c1c264d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:45.189026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 873/1747] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:44 2022] POST /identity/v3/users => generated 309 bytes in 618 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:45.193322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463785e3-c374-4e41-8fa0-d56b5c1c264d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:45.204886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463785e3-c374-4e41-8fa0-d56b5c1c264d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:45.210415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0885d03-c585-4837-8c27-c48b0093a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.211186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885d03-c585-4837-8c27-c48b0093a50a admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.211483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885d03-c585-4837-8c27-c48b0093a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.211764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885d03-c585-4837-8c27-c48b0093a50a admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.213122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0885d03-c585-4837-8c27-c48b0093a50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.215122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0885d03-c585-4837-8c27-c48b0093a50a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:45.229126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 874/1748] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:45.236060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0885d03-c585-4837-8c27-c48b0093a50a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:45.273580 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0885d03-c585-4837-8c27-c48b0093a50a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:45.293508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604a2ca-610b-4d10-86f1-5034de8e5ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.294654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604a2ca-610b-4d10-86f1-5034de8e5ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.294947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604a2ca-610b-4d10-86f1-5034de8e5ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.295237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604a2ca-610b-4d10-86f1-5034de8e5ad0 admin admin] PATH_INFO: `/v3/projects/f769ff64066c463cb3a52c5be76a71e7/users/1541fc590abc406798ce496bd458740b/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.313497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff058b650d044d1afaf1b52cf57355f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.325332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:45.343501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604a2ca-610b-4d10-86f1-5034de8e5ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f769ff64066c463cb3a52c5be76a71e7, user_id=1541fc590abc406798ce496bd458740b, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.347784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604a2ca-610b-4d10-86f1-5034de8e5ad0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:45.360805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff058b650d044d1afaf1b52cf57355f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.486856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 875/1749] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:45 2022] PUT /identity/v3/projects/f769ff64066c463cb3a52c5be76a71e7/users/1541fc590abc406798ce496bd458740b/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:45.491249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa90b-fc61-44cb-b904-bf545a68854f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.492316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff058b650d044d1afaf1b52cf57355f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.494005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff058b650d044d1afaf1b52cf57355f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.500313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa90b-fc61-44cb-b904-bf545a68854f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.500313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa90b-fc61-44cb-b904-bf545a68854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.501086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff058b650d044d1afaf1b52cf57355f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:45.566812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 875/1750] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:44 2022] DELETE /identity/v3/users/bff058b650d044d1afaf1b52cf57355f => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:45.568955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:45.579477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:45.594336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5a2fa90b-fc61-44cb-b904-bf545a68854f None None] MFA Rules not processed for user `8d419d0520ed48b181dc528aff6364fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:45.596176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5a2fa90b-fc61-44cb-b904-bf545a68854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:45.808926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 876/1751] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:45.811883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5e47d-8af5-4105-82b2-8896f9085322 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.812185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5e47d-8af5-4105-82b2-8896f9085322 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.812473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5e47d-8af5-4105-82b2-8896f9085322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.835471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-63c5e47d-8af5-4105-82b2-8896f9085322 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:45.836733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-63c5e47d-8af5-4105-82b2-8896f9085322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:45.920139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129e8f0-8c4f-4c21-aafd-91a1e187459a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:45.945777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:45.947301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:45.950447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:45.950767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:45.951592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:45.953269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:46.019916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 876/1752] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:46.019916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:46.027740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:46.035821 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 877/1753] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:46.038375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c08c5-c282-4c43-a25d-2e1ff2a3002e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.038911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c08c5-c282-4c43-a25d-2e1ff2a3002e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.039789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c08c5-c282-4c43-a25d-2e1ff2a3002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.168407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5a1c08c5-c282-4c43-a25d-2e1ff2a3002e None None] MFA Rules not processed for user `4705101941674ef0839a6cff5d1bab2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:46.171996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5a1c08c5-c282-4c43-a25d-2e1ff2a3002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:46.213262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:46.303622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9af4-de2d-488a-924c-a68dc5ff701b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:46.313794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:46.314536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.314870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.315155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.346601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 878/1754] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:46.347741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c08c5-c282-4c43-a25d-2e1ff2a3002e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:46.352092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:46.353735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:46.371033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c08c5-c282-4c43-a25d-2e1ff2a3002e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:46.375195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 877/1755] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:46.378234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:46.380412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:46.385926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:46.387011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.387304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.387586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] PATH_INFO: `/v3/projects/f769ff64066c463cb3a52c5be76a71e7/users/1541fc590abc406798ce496bd458740b/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.392443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f769ff64066c463cb3a52c5be76a71e7, user_id=1541fc590abc406798ce496bd458740b, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:46.395519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:46.434673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 879/1756] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:46 2022] PUT /identity/v3/projects/f769ff64066c463cb3a52c5be76a71e7/users/1541fc590abc406798ce496bd458740b/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:46.435716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:46.441769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:46.548778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e8239-5cbb-4ead-815c-7dfd8ac02428 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:46.554242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:46.676817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da7a2-9741-4893-9557-c92d46b50f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:46.678355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da7a2-9741-4893-9557-c92d46b50f07 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.678795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da7a2-9741-4893-9557-c92d46b50f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.679214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da7a2-9741-4893-9557-c92d46b50f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.701729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05da7a2-9741-4893-9557-c92d46b50f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:46.706352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05da7a2-9741-4893-9557-c92d46b50f07 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:46.737577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 878/1757] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:46.741290 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53728a04-1403-4cd5-846c-b4cc9010c5e9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.741598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53728a04-1403-4cd5-846c-b4cc9010c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.741724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d0bcc-2a1d-40c1-b74e-e211d3f66e18 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:46.742189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53728a04-1403-4cd5-846c-b4cc9010c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.763884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:46.767167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:46.768216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:46.771517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] PATH_INFO: `/v3/projects/2a5116292e724e43a8c539c4788294d2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:46.777104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5116292e724e43a8c539c4788294d2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:46.788274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:46.800365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-53728a04-1403-4cd5-846c-b4cc9010c5e9 None None] MFA Rules not processed for user `e32767611f7d417184f55c8e7fa645b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:46.803266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-53728a04-1403-4cd5-846c-b4cc9010c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:46.965072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 879/1758] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:46.966115 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53728a04-1403-4cd5-846c-b4cc9010c5e9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:46.973250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-53728a04-1403-4cd5-846c-b4cc9010c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:47.130110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5116292e724e43a8c539c4788294d2', 'request_id': 'req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:47.162792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5116292e724e43a8c539c4788294d2', 'request_id': 'req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:47.252873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53728a04-1403-4cd5-846c-b4cc9010c5e9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:47.261273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5116292e724e43a8c539c4788294d2', 'request_id': 'req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:47.314044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] The token cache is being invalidate because project 2a5116292e724e43a8c539c4788294d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:47.314682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:47.320540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3ff30e00-f1a6-4a1a-914a-37bbbd14c5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:47.323739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 880/1759] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:46 2022] DELETE /identity/v3/projects/2a5116292e724e43a8c539c4788294d2 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:47.335742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab41f-7159-4318-86fc-8a286b8a29c2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.339804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab41f-7159-4318-86fc-8a286b8a29c2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.339804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab41f-7159-4318-86fc-8a286b8a29c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.409796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:47.456389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:47.456979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.457268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.457544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.466669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:47.490074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ab8ab41f-7159-4318-86fc-8a286b8a29c2 None None] MFA Rules not processed for user `00e99aa4e6c14e7bafa57df2c867e9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:47.505304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ab8ab41f-7159-4318-86fc-8a286b8a29c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:47.700901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:47.781607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:47.796572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:47.826521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 881/1760] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:47.828013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aafe4-b0c7-4f39-9a5a-5f6d93d1329d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:47.828311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aafe4-b0c7-4f39-9a5a-5f6d93d1329d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:47.829194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aafe4-b0c7-4f39-9a5a-5f6d93d1329d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:47.846830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 880/1761] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:47.871991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-233aafe4-b0c7-4f39-9a5a-5f6d93d1329d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:47.873280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-233aafe4-b0c7-4f39-9a5a-5f6d93d1329d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:48.014807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:48.017119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:48.095996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 882/1762] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:48.104169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a09e-4537-44cd-b00d-1b9eff0c84e2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:48.104458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a09e-4537-44cd-b00d-1b9eff0c84e2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:48.104754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a09e-4537-44cd-b00d-1b9eff0c84e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:48.194484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7de6a09e-4537-44cd-b00d-1b9eff0c84e2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:48.198024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7de6a09e-4537-44cd-b00d-1b9eff0c84e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:48.243279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 883/1763] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:48.251206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6a09e-4537-44cd-b00d-1b9eff0c84e2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:48.279350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a369ea1-d583-4ac8-b2a1-8fb47dbf49c0 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:48.292108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6a09e-4537-44cd-b00d-1b9eff0c84e2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:48.306938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:48.307769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:48.308366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:48.308677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:48.308970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:48.309472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] PATH_INFO: `/v3/projects/57241f6ed47545b7ba4fbb66e8767f16` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:48.310820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:48.311257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:48.311978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:48.312625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:48.315572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=57241f6ed47545b7ba4fbb66e8767f16)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:48.317737 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:48.324823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:48.354933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 884/1764] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:48.359537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:48.392924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c4cb-2203-4f34-8621-d86600231105 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:48.425783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887b80-33d1-4778-9299-5d1f0d6d8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:48.425783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887b80-33d1-4778-9299-5d1f0d6d8214 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:48.425783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887b80-33d1-4778-9299-5d1f0d6d8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:48.425783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887b80-33d1-4778-9299-5d1f0d6d8214 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:48.428003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce887b80-33d1-4778-9299-5d1f0d6d8214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:48.428003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce887b80-33d1-4778-9299-5d1f0d6d8214 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:48.623598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 885/1765] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:48 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:15:48.631061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887b80-33d1-4778-9299-5d1f0d6d8214 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:48.670056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57241f6ed47545b7ba4fbb66e8767f16', 'request_id': 'req-e95394fd-1764-4cf8-8c7f-2563d26007fb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:48.877479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887b80-33d1-4778-9299-5d1f0d6d8214 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:48.896000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651b9fc-000e-48b9-af73-ce7a1ab67cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:48.897125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b9fc-000e-48b9-af73-ce7a1ab67cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:48.897697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b9fc-000e-48b9-af73-ce7a1ab67cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:48.898268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b9fc-000e-48b9-af73-ce7a1ab67cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:48.899200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651b9fc-000e-48b9-af73-ce7a1ab67cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:48.909269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651b9fc-000e-48b9-af73-ce7a1ab67cc0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:48.963966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57241f6ed47545b7ba4fbb66e8767f16', 'request_id': 'req-e95394fd-1764-4cf8-8c7f-2563d26007fb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:48.973996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57241f6ed47545b7ba4fbb66e8767f16', 'request_id': 'req-e95394fd-1764-4cf8-8c7f-2563d26007fb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:49.007821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] The token cache is being invalidate because project 57241f6ed47545b7ba4fbb66e8767f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:49.007821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:49.007821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e95394fd-1764-4cf8-8c7f-2563d26007fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:49.017473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 881/1766] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:48 2022] DELETE /identity/v3/projects/57241f6ed47545b7ba4fbb66e8767f16 => generated 0 bytes in 1004 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:49.022396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25d809-dad1-49c4-8621-2e3ea3c012a4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:49.023586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25d809-dad1-49c4-8621-2e3ea3c012a4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:49.025059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25d809-dad1-49c4-8621-2e3ea3c012a4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:49.030999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 882/1767] 10.222.0.48 () {54 vars in 912 bytes} [Mon May 30 12:15:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:49.056876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25d809-dad1-49c4-8621-2e3ea3c012a4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:49.071743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 886/1768] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:48 2022] POST /identity/v3/users => generated 292 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:49.073458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578fb4-ca0e-4848-a5a5-3f5ee15ed6ff None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:49.081528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578fb4-ca0e-4848-a5a5-3f5ee15ed6ff None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:49.082168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578fb4-ca0e-4848-a5a5-3f5ee15ed6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:49.083262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5f25d809-dad1-49c4-8621-2e3ea3c012a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:49.124768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-48578fb4-ca0e-4848-a5a5-3f5ee15ed6ff None None] MFA Rules not processed for user `35763651d4614bf68400b5efce4113a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:49.126938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-48578fb4-ca0e-4848-a5a5-3f5ee15ed6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:49.130600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25d809-dad1-49c4-8621-2e3ea3c012a4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:49.181747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:49.200865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:49.202794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:49.203990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] PATH_INFO: `/v3/users/b12e294f8eb443f4956d5bba2ec63176` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:49.209040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12e294f8eb443f4956d5bba2ec63176)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:49.227815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:49.232866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:49.294234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:49.349395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 887/1769] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:49.358978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48578fb4-ca0e-4848-a5a5-3f5ee15ed6ff None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:49.371127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-48578fb4-ca0e-4848-a5a5-3f5ee15ed6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:49.417516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48578fb4-ca0e-4848-a5a5-3f5ee15ed6ff None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:49.449691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b06e3-6bbd-42ae-adee-c7cfe0c12c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:49.451066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b06e3-6bbd-42ae-adee-c7cfe0c12c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:49.451364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b06e3-6bbd-42ae-adee-c7cfe0c12c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:49.453925 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b06e3-6bbd-42ae-adee-c7cfe0c12c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:49.455743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b06e3-6bbd-42ae-adee-c7cfe0c12c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:49.460934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b06e3-6bbd-42ae-adee-c7cfe0c12c7e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:49.519064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 888/1770] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:49.527331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2bc0-cd11-4f3a-a2c6-54f42f6fef9c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:49.529025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2bc0-cd11-4f3a-a2c6-54f42f6fef9c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:49.530510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2bc0-cd11-4f3a-a2c6-54f42f6fef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:49.597312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12e294f8eb443f4956d5bba2ec63176'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:49.630903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12e294f8eb443f4956d5bba2ec63176'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:49.641549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-3a6b2bc0-cd11-4f3a-a2c6-54f42f6fef9c None None] MFA Rules not processed for user `1541fc590abc406798ce496bd458740b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:49.643368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3a6b2bc0-cd11-4f3a-a2c6-54f42f6fef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:49.751962 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12e294f8eb443f4956d5bba2ec63176'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:49.754694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12e294f8eb443f4956d5bba2ec63176'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:49.754694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12e294f8eb443f4956d5bba2ec63176'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:49.790300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 889/1771] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:49.790300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2bc0-cd11-4f3a-a2c6-54f42f6fef9c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:49.790300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3a6b2bc0-cd11-4f3a-a2c6-54f42f6fef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:49.810254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2bc0-cd11-4f3a-a2c6-54f42f6fef9c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:49.817307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:49.818210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:49.818551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:49.818946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:49.823302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:49.828771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 883/1772] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:49 2022] DELETE /identity/v3/users/b12e294f8eb443f4956d5bba2ec63176 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:49.830536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:49.845425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:49.845619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:49.845619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:49.868070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 890/1773] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:50.028687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e732d3-0670-474d-a3f2-f0c4691b3f45 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:50.042780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec11204-67e8-4cbe-9b94-d2f33c960013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:50.043826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11204-67e8-4cbe-9b94-d2f33c960013 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:50.048918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11204-67e8-4cbe-9b94-d2f33c960013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:50.052099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11204-67e8-4cbe-9b94-d2f33c960013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:50.052099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec11204-67e8-4cbe-9b94-d2f33c960013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:50.062509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec11204-67e8-4cbe-9b94-d2f33c960013 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:50.097461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 884/1774] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:50.098359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:50.114101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50769c8e-5536-4e8d-a0f2-396c6b7b573d service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:50.130091 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c756ae-23f6-428d-8d14-c90ecabd47fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:50.131750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c756ae-23f6-428d-8d14-c90ecabd47fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:50.132190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c756ae-23f6-428d-8d14-c90ecabd47fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:50.132639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c756ae-23f6-428d-8d14-c90ecabd47fd admin admin] PATH_INFO: `/v3/projects/4d9274caaf13492a87b02f1daf501387/users/21f648b85bdf4eb4ac70b2167e2ccd93/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:50.182845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c756ae-23f6-428d-8d14-c90ecabd47fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9274caaf13492a87b02f1daf501387, user_id=21f648b85bdf4eb4ac70b2167e2ccd93, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:50.185703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c756ae-23f6-428d-8d14-c90ecabd47fd admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:50.281063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 891/1775] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:50 2022] PUT /identity/v3/projects/4d9274caaf13492a87b02f1daf501387/users/21f648b85bdf4eb4ac70b2167e2ccd93/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:50.293760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca27c4-552a-4031-bca7-83d282f32335 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:50.294101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca27c4-552a-4031-bca7-83d282f32335 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:50.294392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca27c4-552a-4031-bca7-83d282f32335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:50.334299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0fca27c4-552a-4031-bca7-83d282f32335 None None] MFA Rules not processed for user `21f648b85bdf4eb4ac70b2167e2ccd93`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:50.336022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0fca27c4-552a-4031-bca7-83d282f32335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:50.485980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 885/1776] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:50.486739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c756ae-23f6-428d-8d14-c90ecabd47fd admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:50.622261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c756ae-23f6-428d-8d14-c90ecabd47fd admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:50.628326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4e4c6-ad99-491b-b49c-fbbed2d96fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:50.631389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e4c6-ad99-491b-b49c-fbbed2d96fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:50.631389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e4c6-ad99-491b-b49c-fbbed2d96fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:50.631389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e4c6-ad99-491b-b49c-fbbed2d96fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:50.631389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4e4c6-ad99-491b-b49c-fbbed2d96fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:50.633050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4e4c6-ad99-491b-b49c-fbbed2d96fbc admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:50.749429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca27c4-552a-4031-bca7-83d282f32335 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:50.750914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 892/1777] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:50 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:50.763239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca27c4-552a-4031-bca7-83d282f32335 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:50.780245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:50.959963 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b3cb-1192-4118-bec9-52f455ba06bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:50.961191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b3cb-1192-4118-bec9-52f455ba06bb admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:50.962277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b3cb-1192-4118-bec9-52f455ba06bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:50.962667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b3cb-1192-4118-bec9-52f455ba06bb admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:50.963486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98b3cb-1192-4118-bec9-52f455ba06bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:50.965880 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98b3cb-1192-4118-bec9-52f455ba06bb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:51.086698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 886/1778] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:50 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:51.091679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4e4c6-ad99-491b-b49c-fbbed2d96fbc admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:51.098314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:51.109022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4e4c6-ad99-491b-b49c-fbbed2d96fbc admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:51.126106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eec1f9-c057-412b-8920-957a242b743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:51.127573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec1f9-c057-412b-8920-957a242b743a admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:51.128180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec1f9-c057-412b-8920-957a242b743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:51.128981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec1f9-c057-412b-8920-957a242b743a admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:51.130662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eec1f9-c057-412b-8920-957a242b743a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:51.132652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eec1f9-c057-412b-8920-957a242b743a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:51.152971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b3cb-1192-4118-bec9-52f455ba06bb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:51.163729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 893/1779] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:51.176080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b3cb-1192-4118-bec9-52f455ba06bb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:51.184875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679012-099e-4d2d-8ed5-e2cc2242d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:51.188308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679012-099e-4d2d-8ed5-e2cc2242d505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:51.188308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679012-099e-4d2d-8ed5-e2cc2242d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:51.188308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679012-099e-4d2d-8ed5-e2cc2242d505 admin admin] PATH_INFO: `/v3/projects/0302fbdc165d4d3e8e9b5ef040f77016/users/d8666d8b6572434a9d89caae16ab7e9e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:51.223145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9679012-099e-4d2d-8ed5-e2cc2242d505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0302fbdc165d4d3e8e9b5ef040f77016, user_id=d8666d8b6572434a9d89caae16ab7e9e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:51.223675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9679012-099e-4d2d-8ed5-e2cc2242d505 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:51.347693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 887/1780] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:51 2022] PUT /identity/v3/projects/0302fbdc165d4d3e8e9b5ef040f77016/users/d8666d8b6572434a9d89caae16ab7e9e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:51.351626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eec1f9-c057-412b-8920-957a242b743a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:51.377889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eec1f9-c057-412b-8920-957a242b743a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:51.462008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:51.463140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:51.463663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:51.464160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:51.465183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:51.467163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:51.479776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 894/1781] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:51.484045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679012-099e-4d2d-8ed5-e2cc2242d505 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:51.503072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:51.509675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679012-099e-4d2d-8ed5-e2cc2242d505 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:51.524747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:51.539347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a39e9-cb43-4d26-b3df-195ec6d7d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:51.542381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a39e9-cb43-4d26-b3df-195ec6d7d075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:51.544504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a39e9-cb43-4d26-b3df-195ec6d7d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:51.544856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a39e9-cb43-4d26-b3df-195ec6d7d075 admin admin] PATH_INFO: `/v3/projects/0302fbdc165d4d3e8e9b5ef040f77016/users/d8666d8b6572434a9d89caae16ab7e9e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:51.551966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a39e9-cb43-4d26-b3df-195ec6d7d075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0302fbdc165d4d3e8e9b5ef040f77016, user_id=d8666d8b6572434a9d89caae16ab7e9e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:51.560322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a39e9-cb43-4d26-b3df-195ec6d7d075 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:51.561438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ba6ba-492e-4149-aa1d-595833fc9746 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:51.590264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:51.591156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:51.593475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:51.595324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] PATH_INFO: `/v3/projects/9c23ebea4ab7447bb12dd4a856db9cac` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:51.598570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c23ebea4ab7447bb12dd4a856db9cac)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:51.604775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 888/1782] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:51 2022] PUT /identity/v3/projects/0302fbdc165d4d3e8e9b5ef040f77016/users/d8666d8b6572434a9d89caae16ab7e9e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:51.605095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:51.623680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3af3dc-e1ab-4d14-8d0f-62f50517ee28 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:51.624172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3af3dc-e1ab-4d14-8d0f-62f50517ee28 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:51.624470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3af3dc-e1ab-4d14-8d0f-62f50517ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:51.729339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ef3af3dc-e1ab-4d14-8d0f-62f50517ee28 None None] MFA Rules not processed for user `d8666d8b6572434a9d89caae16ab7e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:51.731262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ef3af3dc-e1ab-4d14-8d0f-62f50517ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:51.833426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c23ebea4ab7447bb12dd4a856db9cac', 'request_id': 'req-62537df2-8737-4de8-a7ed-ed8bfb910b9f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:51.853794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c23ebea4ab7447bb12dd4a856db9cac', 'request_id': 'req-62537df2-8737-4de8-a7ed-ed8bfb910b9f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:51.974282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 889/1783] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:51.975995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e122186-ceb8-4ead-963d-85a07a6a75f1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:51.976508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e122186-ceb8-4ead-963d-85a07a6a75f1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:51.977024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e122186-ceb8-4ead-963d-85a07a6a75f1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:51.988081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 890/1784] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:15:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:51.989418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e122186-ceb8-4ead-963d-85a07a6a75f1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:51.991723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2e122186-ceb8-4ead-963d-85a07a6a75f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:51.998392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c23ebea4ab7447bb12dd4a856db9cac', 'request_id': 'req-62537df2-8737-4de8-a7ed-ed8bfb910b9f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:52.046610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] The token cache is being invalidate because project 9c23ebea4ab7447bb12dd4a856db9cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:52.047038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:52.049305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-62537df2-8737-4de8-a7ed-ed8bfb910b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:52.051981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 895/1785] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:51 2022] DELETE /identity/v3/projects/9c23ebea4ab7447bb12dd4a856db9cac => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:52.058612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbeb81-c94b-4bd8-849e-51411e7d16d2 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.060300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbeb81-c94b-4bd8-849e-51411e7d16d2 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.060827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbeb81-c94b-4bd8-849e-51411e7d16d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.142608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-decbeb81-c94b-4bd8-849e-51411e7d16d2 None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:52.146295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-decbeb81-c94b-4bd8-849e-51411e7d16d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.150395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e122186-ceb8-4ead-963d-85a07a6a75f1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:52.158080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e288d7f-6c0c-4ad5-b83e-33c75fc5dfff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:52.159262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288d7f-6c0c-4ad5-b83e-33c75fc5dfff service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.159758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288d7f-6c0c-4ad5-b83e-33c75fc5dfff service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.160492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288d7f-6c0c-4ad5-b83e-33c75fc5dfff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.163662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9e288d7f-6c0c-4ad5-b83e-33c75fc5dfff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.268482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e288d7f-6c0c-4ad5-b83e-33c75fc5dfff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:52.270934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e288d7f-6c0c-4ad5-b83e-33c75fc5dfff service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:52.293933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 891/1786] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:52.299006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e8d2-d622-4978-93b3-f826b7d0de9a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.300590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e8d2-d622-4978-93b3-f826b7d0de9a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.303141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932e8d2-d622-4978-93b3-f826b7d0de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.308660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 896/1787] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:15:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:52.340674 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a932e8d2-d622-4978-93b3-f826b7d0de9a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:52.344996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a932e8d2-d622-4978-93b3-f826b7d0de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.423860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbeb81-c94b-4bd8-849e-51411e7d16d2 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:52.424097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-decbeb81-c94b-4bd8-849e-51411e7d16d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.487811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbeb81-c94b-4bd8-849e-51411e7d16d2 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:52.501930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65513c0-6b91-4337-b0cd-1dd646d14bc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:52.502857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65513c0-6b91-4337-b0cd-1dd646d14bc9 service placement] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.503153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65513c0-6b91-4337-b0cd-1dd646d14bc9 service placement] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.503434 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65513c0-6b91-4337-b0cd-1dd646d14bc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.511186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:52.518171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65513c0-6b91-4337-b0cd-1dd646d14bc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:52.533641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65513c0-6b91-4337-b0cd-1dd646d14bc9 service placement] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:52.576755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 892/1788] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:52.578490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4615d-db23-4f80-bec8-ae95d593c226 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.578785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4615d-db23-4f80-bec8-ae95d593c226 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.579708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4615d-db23-4f80-bec8-ae95d593c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.591402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 897/1789] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:52.631359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c6f4615d-db23-4f80-bec8-ae95d593c226 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:52.631359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c6f4615d-db23-4f80-bec8-ae95d593c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:52.655173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 893/1790] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:52.656961 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65513c0-6b91-4337-b0cd-1dd646d14bc9 service placement] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:52.660829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:52.676534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65513c0-6b91-4337-b0cd-1dd646d14bc9 service placement] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:52.696435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:52.698916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.700656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.701160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.702481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:52.704174 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:52.708306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:52.752673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 898/1791] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:52.759267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4615d-db23-4f80-bec8-ae95d593c226 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:52.771145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4615d-db23-4f80-bec8-ae95d593c226 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:52.777561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025d542-ad6f-411a-8e6a-82607823e93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:52.778405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025d542-ad6f-411a-8e6a-82607823e93f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.778997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025d542-ad6f-411a-8e6a-82607823e93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.779286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025d542-ad6f-411a-8e6a-82607823e93f admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.779986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025d542-ad6f-411a-8e6a-82607823e93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:52.786919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025d542-ad6f-411a-8e6a-82607823e93f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:52.887556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:52.899895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 894/1792] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:52 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:52.904509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2077f-e9c8-4c5a-90aa-ad1bd982877d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:52.988976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb95a-2627-4944-b5e1-1ac85e41dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:52.990422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb95a-2627-4944-b5e1-1ac85e41dfaf admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:52.991136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb95a-2627-4944-b5e1-1ac85e41dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:52.991629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb95a-2627-4944-b5e1-1ac85e41dfaf admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:52.992568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb95a-2627-4944-b5e1-1ac85e41dfaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:52.995256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb95a-2627-4944-b5e1-1ac85e41dfaf admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.155470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 899/1793] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:52 2022] POST /identity/v3/users => generated 282 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:53.156065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025d542-ad6f-411a-8e6a-82607823e93f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.191521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025d542-ad6f-411a-8e6a-82607823e93f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.206849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725d3a-3694-4e0a-a929-5996af4d24a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.214096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725d3a-3694-4e0a-a929-5996af4d24a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.223543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725d3a-3694-4e0a-a929-5996af4d24a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.224205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725d3a-3694-4e0a-a929-5996af4d24a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.228883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725d3a-3694-4e0a-a929-5996af4d24a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.233706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725d3a-3694-4e0a-a929-5996af4d24a3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.292357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 895/1794] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:53.296762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb95a-2627-4944-b5e1-1ac85e41dfaf admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.312193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb95a-2627-4944-b5e1-1ac85e41dfaf admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.327429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97a0aa-7549-4c7c-a3e0-eb8659cb7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.331852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a0aa-7549-4c7c-a3e0-eb8659cb7e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.331852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a0aa-7549-4c7c-a3e0-eb8659cb7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.331852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a0aa-7549-4c7c-a3e0-eb8659cb7e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.331852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97a0aa-7549-4c7c-a3e0-eb8659cb7e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.332290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97a0aa-7549-4c7c-a3e0-eb8659cb7e93 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.350220 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 900/1795] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:53.355230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725d3a-3694-4e0a-a929-5996af4d24a3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.389389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725d3a-3694-4e0a-a929-5996af4d24a3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.403210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541128b5-a807-4fc4-8860-929a12078178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.404603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541128b5-a807-4fc4-8860-929a12078178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.404901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541128b5-a807-4fc4-8860-929a12078178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.405181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541128b5-a807-4fc4-8860-929a12078178 admin admin] PATH_INFO: `/v3/projects/688d3037f7d845e7bbbf7b3356fd1d5b/users/fde6a089eb064d9b92a1b621f2aea09f/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.438461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541128b5-a807-4fc4-8860-929a12078178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688d3037f7d845e7bbbf7b3356fd1d5b, user_id=fde6a089eb064d9b92a1b621f2aea09f, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.448765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541128b5-a807-4fc4-8860-929a12078178 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.569830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 896/1796] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:53 2022] PUT /identity/v3/projects/688d3037f7d845e7bbbf7b3356fd1d5b/users/fde6a089eb064d9b92a1b621f2aea09f/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:53.580738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639aea6-76b4-44a4-a8f4-deea6a5aa741 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.581038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639aea6-76b4-44a4-a8f4-deea6a5aa741 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.581326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639aea6-76b4-44a4-a8f4-deea6a5aa741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.625774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8639aea6-76b4-44a4-a8f4-deea6a5aa741 None None] MFA Rules not processed for user `fde6a089eb064d9b92a1b621f2aea09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:53.627185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8639aea6-76b4-44a4-a8f4-deea6a5aa741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:53.684869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6480-9516-4a49-9e1d-01139767bb5d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.685168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6480-9516-4a49-9e1d-01139767bb5d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.685446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6480-9516-4a49-9e1d-01139767bb5d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.688232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 897/1797] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:15:53.749770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84757c-c6e1-4287-bd9a-f823ace6b137 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.749770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84757c-c6e1-4287-bd9a-f823ace6b137 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.749770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84757c-c6e1-4287-bd9a-f823ace6b137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.786031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6e84757c-c6e1-4287-bd9a-f823ace6b137 None None] MFA Rules not processed for user `49f847d54d334342b54d6f3189166ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:53.787753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6e84757c-c6e1-4287-bd9a-f823ace6b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:53.793999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 901/1798] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:53.803703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639aea6-76b4-44a4-a8f4-deea6a5aa741 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:53.948231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 898/1799] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:53.949307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639aea6-76b4-44a4-a8f4-deea6a5aa741 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:53.965945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a31777-23e6-4b3f-945d-ad586bc46f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:53.966717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a31777-23e6-4b3f-945d-ad586bc46f7f admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:53.967059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a31777-23e6-4b3f-945d-ad586bc46f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:53.967392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a31777-23e6-4b3f-945d-ad586bc46f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:53.968242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a31777-23e6-4b3f-945d-ad586bc46f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:53.971543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a31777-23e6-4b3f-945d-ad586bc46f7f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:53.987216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84757c-c6e1-4287-bd9a-f823ace6b137 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:54.000922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84757c-c6e1-4287-bd9a-f823ace6b137 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:54.011943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:54.012625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:54.013166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:54.013461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:54.026321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:54.028013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:54.050113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 899/1800] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:15:54.337769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:54.339718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:54.358020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd00ce8-d4f0-4a5f-ae55-20e8662914dd service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:54.363196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:54.364151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:54.364438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:54.364716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] PATH_INFO: `/v3/users/afae9add6a7443feb8e35da1d3aa91f6` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:54.366255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afae9add6a7443feb8e35da1d3aa91f6)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:54.368455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:54.802643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 902/1801] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:53 2022] POST /identity/v3/projects => generated 365 bytes in 999 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:54.806510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a31777-23e6-4b3f-945d-ad586bc46f7f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:54.827267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:54.882648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a31777-23e6-4b3f-945d-ad586bc46f7f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:54.887534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65a83-c4dc-4d9a-b431-546d45747f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:54.888177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65a83-c4dc-4d9a-b431-546d45747f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:54.888463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65a83-c4dc-4d9a-b431-546d45747f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:54.888745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65a83-c4dc-4d9a-b431-546d45747f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:54.889441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65a83-c4dc-4d9a-b431-546d45747f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:54.891554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b65a83-c4dc-4d9a-b431-546d45747f1a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:54.935236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afae9add6a7443feb8e35da1d3aa91f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:54.944687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afae9add6a7443feb8e35da1d3aa91f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:54.998362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 903/1802] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:54 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:15:54.999745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80169-08d8-47fa-a354-7b3efc8fed71 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.000073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80169-08d8-47fa-a354-7b3efc8fed71 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.000357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80169-08d8-47fa-a354-7b3efc8fed71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.039076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5ee80169-08d8-47fa-a354-7b3efc8fed71 None None] MFA Rules not processed for user `8d419d0520ed48b181dc528aff6364fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:55.039925 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5ee80169-08d8-47fa-a354-7b3efc8fed71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:55.041895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afae9add6a7443feb8e35da1d3aa91f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:55.047544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afae9add6a7443feb8e35da1d3aa91f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:55.047544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afae9add6a7443feb8e35da1d3aa91f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:55.067729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:55.083781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 900/1803] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:54 2022] DELETE /identity/v3/users/afae9add6a7443feb8e35da1d3aa91f6 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:55.083781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:55.086654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:55.135394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 904/1804] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:55.197799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d7258-3495-406e-951d-4be9ed15de78 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:55.204150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd5163-75e5-4e8a-964e-fe9a4ca10f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:55.204928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5163-75e5-4e8a-964e-fe9a4ca10f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.205224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5163-75e5-4e8a-964e-fe9a4ca10f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.205493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5163-75e5-4e8a-964e-fe9a4ca10f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.206264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd5163-75e5-4e8a-964e-fe9a4ca10f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:55.208121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd5163-75e5-4e8a-964e-fe9a4ca10f8a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:55.231393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 901/1805] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:55.236191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80169-08d8-47fa-a354-7b3efc8fed71 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:55.265365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80169-08d8-47fa-a354-7b3efc8fed71 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:55.282146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a1da9-920b-48c3-a437-71cec545e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:55.283127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1da9-920b-48c3-a437-71cec545e33e admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.283411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1da9-920b-48c3-a437-71cec545e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.284125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1da9-920b-48c3-a437-71cec545e33e admin admin] PATH_INFO: `/v3/projects/8022d4aed84341ffa1228384445cb763/users/cb5585f74142418880b2ba4bcf21c7fc/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.314886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1da9-920b-48c3-a437-71cec545e33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8022d4aed84341ffa1228384445cb763, user_id=cb5585f74142418880b2ba4bcf21c7fc, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:55.320034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1da9-920b-48c3-a437-71cec545e33e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:55.410312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 905/1806] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:55 2022] PUT /identity/v3/projects/8022d4aed84341ffa1228384445cb763/users/cb5585f74142418880b2ba4bcf21c7fc/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:55.414168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd5163-75e5-4e8a-964e-fe9a4ca10f8a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:55.427976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd5163-75e5-4e8a-964e-fe9a4ca10f8a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:55.522174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:55.523116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.523531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.523891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.524811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:55.526619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:55.548397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 902/1807] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:55.549619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a1da9-920b-48c3-a437-71cec545e33e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:55.558400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:55.560792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a1da9-920b-48c3-a437-71cec545e33e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:55.561417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:55.580027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139510-8b45-4342-8903-315ef9b6b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:55.580027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139510-8b45-4342-8903-315ef9b6b8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.580027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139510-8b45-4342-8903-315ef9b6b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.580027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139510-8b45-4342-8903-315ef9b6b8f9 admin admin] PATH_INFO: `/v3/projects/8022d4aed84341ffa1228384445cb763/users/cb5585f74142418880b2ba4bcf21c7fc/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.584181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139510-8b45-4342-8903-315ef9b6b8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8022d4aed84341ffa1228384445cb763, user_id=cb5585f74142418880b2ba4bcf21c7fc, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:55.589153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139510-8b45-4342-8903-315ef9b6b8f9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:55.597527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864b2bb-e0a4-4884-9b1b-95c8f0ef5393 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:55.601708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 906/1808] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:55 2022] PUT /identity/v3/projects/8022d4aed84341ffa1228384445cb763/users/cb5585f74142418880b2ba4bcf21c7fc/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:55.614172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023644-28a4-40ae-9f38-4e36433bec8b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.614513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023644-28a4-40ae-9f38-4e36433bec8b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.614746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023644-28a4-40ae-9f38-4e36433bec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.646192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-cd023644-28a4-40ae-9f38-4e36433bec8b None None] MFA Rules not processed for user `cb5585f74142418880b2ba4bcf21c7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:55.650832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cd023644-28a4-40ae-9f38-4e36433bec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:55.688617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:55.689642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.690105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.690530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] PATH_INFO: `/v3/projects/f9b3df7d92464bb5894f9235fbb9240c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.691921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b3df7d92464bb5894f9235fbb9240c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:55.694270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:55.779351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 907/1809] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:55.781768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b5c34-86b6-4702-ba06-4af09bd935cb None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.782361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b5c34-86b6-4702-ba06-4af09bd935cb None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.782930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b5c34-86b6-4702-ba06-4af09bd935cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.805926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-521b5c34-86b6-4702-ba06-4af09bd935cb None None] MFA Rules not processed for user `4705101941674ef0839a6cff5d1bab2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:55.807305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-521b5c34-86b6-4702-ba06-4af09bd935cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:55.820565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b3df7d92464bb5894f9235fbb9240c', 'request_id': 'req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:55.890077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 908/1810] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:55.890077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b5c34-86b6-4702-ba06-4af09bd935cb None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:55.891477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-521b5c34-86b6-4702-ba06-4af09bd935cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:55.926193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b3df7d92464bb5894f9235fbb9240c', 'request_id': 'req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:55.933668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b3df7d92464bb5894f9235fbb9240c', 'request_id': 'req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:55.947978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] The token cache is being invalidate because project f9b3df7d92464bb5894f9235fbb9240c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:55.948410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:55.949176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:55.952171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 903/1811] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:55 2022] DELETE /identity/v3/projects/f9b3df7d92464bb5894f9235fbb9240c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:55.956506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:55.958217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:55.959698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b5c34-86b6-4702-ba06-4af09bd935cb None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:55.966818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:55.969593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:55.969593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:55.969593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:55.972045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:56.075161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:56.075360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:56.075360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:56.087577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3581b6-ce97-4e36-97ba-aad3a930f8ae admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:56.098867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 909/1812] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:56.110665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:56.111790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:56.112106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:56.112396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] PATH_INFO: `/v3/users/1541fc590abc406798ce496bd458740b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:56.114892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1541fc590abc406798ce496bd458740b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:56.117783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:56.200192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:56.421102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1541fc590abc406798ce496bd458740b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:56.423544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:56.425228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:56.434875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1541fc590abc406798ce496bd458740b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:56.441828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf3765-5a25-4bf6-8996-d01179428230 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:56.450279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c569a-4ac4-464c-8503-b3de9c639c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:56.450956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c569a-4ac4-464c-8503-b3de9c639c27 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:56.451249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c569a-4ac4-464c-8503-b3de9c639c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:56.451531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c569a-4ac4-464c-8503-b3de9c639c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:56.453953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e61c569a-4ac4-464c-8503-b3de9c639c27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:56.505953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1541fc590abc406798ce496bd458740b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:56.506620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1541fc590abc406798ce496bd458740b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:56.507258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1541fc590abc406798ce496bd458740b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:56.550541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 904/1813] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:15:55 2022] DELETE /identity/v3/users/1541fc590abc406798ce496bd458740b => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:15:56.582955 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c569a-4ac4-464c-8503-b3de9c639c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:56.587332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c569a-4ac4-464c-8503-b3de9c639c27 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:56.622010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 910/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:15:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:15:57.578969 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:57.669606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:57.675514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:57.795850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afd308-a73f-46b0-a65a-8b77482a4a4e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:57.812744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:57.813685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:57.813988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:57.814284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] PATH_INFO: `/v3/projects/f769ff64066c463cb3a52c5be76a71e7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:57.816594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f769ff64066c463cb3a52c5be76a71e7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:57.819710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:57.992909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f769ff64066c463cb3a52c5be76a71e7', 'request_id': 'req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:58.123399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f769ff64066c463cb3a52c5be76a71e7', 'request_id': 'req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:58.139629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f769ff64066c463cb3a52c5be76a71e7', 'request_id': 'req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:58.168903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:58.168903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] The token cache is being invalidate because project f769ff64066c463cb3a52c5be76a71e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:15:58.168903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:58.168903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5e5a4322-0ba1-4e40-84eb-6a5945d2869b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:15:58.171156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 905/1815] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:15:57 2022] DELETE /identity/v3/projects/f769ff64066c463cb3a52c5be76a71e7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:58.176656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf6d8-9c1e-4b46-8dc4-5a8b3c89b890 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:58.176976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf6d8-9c1e-4b46-8dc4-5a8b3c89b890 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:58.177306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf6d8-9c1e-4b46-8dc4-5a8b3c89b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:58.223490 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-76baf6d8-9c1e-4b46-8dc4-5a8b3c89b890 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:58.225157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-76baf6d8-9c1e-4b46-8dc4-5a8b3c89b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:58.373711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 911/1816] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:58.382056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894b3a-da26-433f-854c-02d066e505ad None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:58.382355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894b3a-da26-433f-854c-02d066e505ad None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:58.382693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54894b3a-da26-433f-854c-02d066e505ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:58.432515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-54894b3a-da26-433f-854c-02d066e505ad None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:58.433764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-54894b3a-da26-433f-854c-02d066e505ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:58.454740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 906/1817] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:58.456372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf6d8-9c1e-4b46-8dc4-5a8b3c89b890 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:58.472176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf6d8-9c1e-4b46-8dc4-5a8b3c89b890 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:58.484917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:58.484917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:58.484917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:58.484917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:58.485209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:15:58.485209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:58.486704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:58.504628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 912/1818] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:15:58.508672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894b3a-da26-433f-854c-02d066e505ad None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:58.523971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54894b3a-da26-433f-854c-02d066e505ad None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:58.529471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fddbe4-d855-4205-bca9-810d5785c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:58.530372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fddbe4-d855-4205-bca9-810d5785c7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:58.530486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fddbe4-d855-4205-bca9-810d5785c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:58.530736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fddbe4-d855-4205-bca9-810d5785c7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:58.531711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fddbe4-d855-4205-bca9-810d5785c7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:58.533661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fddbe4-d855-4205-bca9-810d5785c7c3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:58.706590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 907/1819] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:58 2022] POST /identity/v3/projects => generated 393 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:15:58.707429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:58.730013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6484c-5544-4540-b445-4e65302944c0 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:58.881610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718d234-cb7e-47ae-941f-6bfadcf48c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:58.882393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718d234-cb7e-47ae-941f-6bfadcf48c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:58.882685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718d234-cb7e-47ae-941f-6bfadcf48c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:58.883010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718d234-cb7e-47ae-941f-6bfadcf48c9a admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:58.883912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718d234-cb7e-47ae-941f-6bfadcf48c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:58.886116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718d234-cb7e-47ae-941f-6bfadcf48c9a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:59.019342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 913/1820] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:58 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:59.020682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fddbe4-d855-4205-bca9-810d5785c7c3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:59.041294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fddbe4-d855-4205-bca9-810d5785c7c3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:59.048863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6dc3-87ee-4bd7-915c-801d89b32ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:59.049880 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6dc3-87ee-4bd7-915c-801d89b32ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:59.050400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6dc3-87ee-4bd7-915c-801d89b32ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:59.056165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6dc3-87ee-4bd7-915c-801d89b32ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:59.056165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed6dc3-87ee-4bd7-915c-801d89b32ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:59.056165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed6dc3-87ee-4bd7-915c-801d89b32ee9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:59.073226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718d234-cb7e-47ae-941f-6bfadcf48c9a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:59.073603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 908/1821] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:59.087041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718d234-cb7e-47ae-941f-6bfadcf48c9a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:59.092647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68092128-9913-4c5b-962a-d38d0b047322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:59.093672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092128-9913-4c5b-962a-d38d0b047322 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:59.094140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092128-9913-4c5b-962a-d38d0b047322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:59.094693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092128-9913-4c5b-962a-d38d0b047322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:59.095763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68092128-9913-4c5b-962a-d38d0b047322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:59.097553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68092128-9913-4c5b-962a-d38d0b047322 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:59.113397 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 914/1822] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:15:59.115213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6dc3-87ee-4bd7-915c-801d89b32ee9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:59.127321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6dc3-87ee-4bd7-915c-801d89b32ee9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:59.133361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeffe93-eed1-4df7-99ea-48758e57612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:59.141182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe93-eed1-4df7-99ea-48758e57612d admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:59.141182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe93-eed1-4df7-99ea-48758e57612d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:59.141182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeffe93-eed1-4df7-99ea-48758e57612d admin admin] PATH_INFO: `/v3/projects/f6dceb5040e14b4faa5617868f4a955f/users/85393ab3d5ae438e97081879dacc22e2/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:59.157178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeffe93-eed1-4df7-99ea-48758e57612d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6dceb5040e14b4faa5617868f4a955f, user_id=85393ab3d5ae438e97081879dacc22e2, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:59.161791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeffe93-eed1-4df7-99ea-48758e57612d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:59.314634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 909/1823] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:15:59 2022] PUT /identity/v3/projects/f6dceb5040e14b4faa5617868f4a955f/users/85393ab3d5ae438e97081879dacc22e2/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:15:59.331683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099339d-ce1f-44c3-b01e-9a3867255740 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:59.331683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099339d-ce1f-44c3-b01e-9a3867255740 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:59.331683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099339d-ce1f-44c3-b01e-9a3867255740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:59.404422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8099339d-ce1f-44c3-b01e-9a3867255740 None None] MFA Rules not processed for user `85393ab3d5ae438e97081879dacc22e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:15:59.406464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8099339d-ce1f-44c3-b01e-9a3867255740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:15:59.421218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:59.562680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 915/1824] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:15:59.563105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeffe93-eed1-4df7-99ea-48758e57612d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:59.701658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeffe93-eed1-4df7-99ea-48758e57612d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:15:59.708588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfd39d-997d-4a75-9ddd-231b88926341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:15:59.710142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfd39d-997d-4a75-9ddd-231b88926341 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:15:59.710639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfd39d-997d-4a75-9ddd-231b88926341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:15:59.711151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfd39d-997d-4a75-9ddd-231b88926341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:15:59.713690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfd39d-997d-4a75-9ddd-231b88926341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:15:59.716119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfd39d-997d-4a75-9ddd-231b88926341 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:15:59.893274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 910/1825] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:15:59 2022] POST /identity/v3/projects => generated 393 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:15:59.893570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099339d-ce1f-44c3-b01e-9a3867255740 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:15:59.928861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099339d-ce1f-44c3-b01e-9a3867255740 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:00.047376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a885-a025-41aa-b1f3-d5766931c3d6 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.047767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a885-a025-41aa-b1f3-d5766931c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.048852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a885-a025-41aa-b1f3-d5766931c3d6 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.050971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 911/1826] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:16:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 30 12:16:00.071850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e5685-e63a-4b1d-9916-1676a1046c63 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.074439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e5685-e63a-4b1d-9916-1676a1046c63 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.075055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e5685-e63a-4b1d-9916-1676a1046c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.100484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67c00-402a-4da0-892c-7b216437fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:00.101325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67c00-402a-4da0-892c-7b216437fe19 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.101706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67c00-402a-4da0-892c-7b216437fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.102176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67c00-402a-4da0-892c-7b216437fe19 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.103029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67c00-402a-4da0-892c-7b216437fe19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:00.105230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67c00-402a-4da0-892c-7b216437fe19 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:00.128840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6f4e5685-e63a-4b1d-9916-1676a1046c63 None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:00.132619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6f4e5685-e63a-4b1d-9916-1676a1046c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:00.228000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 916/1827] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:15:59 2022] POST /identity/v3/users => generated 303 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:00.231790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67c00-402a-4da0-892c-7b216437fe19 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:00.271312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67c00-402a-4da0-892c-7b216437fe19 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:00.278479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafad54-af82-442c-828b-2e56e68aa453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:00.279358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafad54-af82-442c-828b-2e56e68aa453 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.279739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafad54-af82-442c-828b-2e56e68aa453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.280114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafad54-af82-442c-828b-2e56e68aa453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.282457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafad54-af82-442c-828b-2e56e68aa453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:00.285420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafad54-af82-442c-828b-2e56e68aa453 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:00.327363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 917/1828] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:00.330142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39857-a489-436e-998d-100855ac998f None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.333385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39857-a489-436e-998d-100855ac998f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.334116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39857-a489-436e-998d-100855ac998f None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.338715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 918/1829] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:16:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:16:00.340088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f39857-a489-436e-998d-100855ac998f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:00.387160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f39857-a489-436e-998d-100855ac998f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:00.393228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 912/1830] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:00.394450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:00.395323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167b93-ffa0-4c8c-8239-10978b86a1fd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.396274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167b93-ffa0-4c8c-8239-10978b86a1fd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.396274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167b93-ffa0-4c8c-8239-10978b86a1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.399009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.399922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.400361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] PATH_INFO: `/v3/projects/6f8a43b40bd44e29958444cfa6bd9b77/users/4ec3404802a14d5080b86324fea02f40/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.424055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8a43b40bd44e29958444cfa6bd9b77, user_id=4ec3404802a14d5080b86324fea02f40, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:00.429032 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:00.456662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ed167b93-ffa0-4c8c-8239-10978b86a1fd None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:00.458884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ed167b93-ffa0-4c8c-8239-10978b86a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:00.484450 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 913/1831] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:00.575527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167b93-ffa0-4c8c-8239-10978b86a1fd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:00.590937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 919/1832] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:00 2022] PUT /identity/v3/projects/6f8a43b40bd44e29958444cfa6bd9b77/users/4ec3404802a14d5080b86324fea02f40/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:00.594927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:00.597821 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:00.603373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167b93-ffa0-4c8c-8239-10978b86a1fd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:00.719766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644b96c-263f-4bc9-ba16-767257b5d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:00.722915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644b96c-263f-4bc9-ba16-767257b5d849 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.722915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644b96c-263f-4bc9-ba16-767257b5d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.722915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644b96c-263f-4bc9-ba16-767257b5d849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.722915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644b96c-263f-4bc9-ba16-767257b5d849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:00.723782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644b96c-263f-4bc9-ba16-767257b5d849 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:00.737152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 914/1833] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:00.741110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644b96c-263f-4bc9-ba16-767257b5d849 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:00.752366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644b96c-263f-4bc9-ba16-767257b5d849 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:00.759371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb82a4-5342-4135-b6a2-3a5cb393fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:00.760296 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb82a4-5342-4135-b6a2-3a5cb393fc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.760763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb82a4-5342-4135-b6a2-3a5cb393fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.761058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb82a4-5342-4135-b6a2-3a5cb393fc67 admin admin] PATH_INFO: `/v3/projects/6f8a43b40bd44e29958444cfa6bd9b77/users/4ec3404802a14d5080b86324fea02f40/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.761638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede6e69-f7a0-42ed-8370-9adfe60ddd26 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:00.763377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb82a4-5342-4135-b6a2-3a5cb393fc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8a43b40bd44e29958444cfa6bd9b77, user_id=4ec3404802a14d5080b86324fea02f40, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:00.767282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb82a4-5342-4135-b6a2-3a5cb393fc67 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:00.768834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:00.769760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.770096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.770365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.780366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 915/1834] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:00 2022] PUT /identity/v3/projects/6f8a43b40bd44e29958444cfa6bd9b77/users/4ec3404802a14d5080b86324fea02f40/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:00.781444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:00.782952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:00.791557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ffe48-8dd7-4fb1-90fa-f831d11aa709 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:00.792083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ffe48-8dd7-4fb1-90fa-f831d11aa709 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:00.792788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ffe48-8dd7-4fb1-90fa-f831d11aa709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:00.809269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 920/1835] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:00.811856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:00.814040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:00.828160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-450ffe48-8dd7-4fb1-90fa-f831d11aa709 None None] MFA Rules not processed for user `4ec3404802a14d5080b86324fea02f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:00.829760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-450ffe48-8dd7-4fb1-90fa-f831d11aa709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:00.833271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87b00d-bf11-472a-9074-2614cf050b57 service nova] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:00.945282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 916/1836] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:00.969571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ffe48-8dd7-4fb1-90fa-f831d11aa709 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:00.969571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-450ffe48-8dd7-4fb1-90fa-f831d11aa709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:01.002002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:01.002859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:01.003275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:01.003626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:01.017074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:01.019392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:01.057715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 921/1837] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:01.086114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:01.097925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ffe48-8dd7-4fb1-90fa-f831d11aa709 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:01.112406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c2354-6a51-4ea2-b26e-d775b710919f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:01.113103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2354-6a51-4ea2-b26e-d775b710919f service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:01.113393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2354-6a51-4ea2-b26e-d775b710919f service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:01.113676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c2354-6a51-4ea2-b26e-d775b710919f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:01.137734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c2354-6a51-4ea2-b26e-d775b710919f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:01.139372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c2354-6a51-4ea2-b26e-d775b710919f service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:01.197604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 917/1838] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:01.308547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:01.374948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:01.375687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:01.395405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856600f-a885-4595-9bf5-5c722c275923 service nova] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:01.401129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648b4f-83ec-481e-97a8-2e688f91a8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:01.401129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648b4f-83ec-481e-97a8-2e688f91a8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:01.401129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648b4f-83ec-481e-97a8-2e688f91a8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:01.401435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648b4f-83ec-481e-97a8-2e688f91a8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:01.531927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba648b4f-83ec-481e-97a8-2e688f91a8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:01.534043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba648b4f-83ec-481e-97a8-2e688f91a8d3 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:01.545375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 922/1839] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:02.362261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c2354-6a51-4ea2-b26e-d775b710919f service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:02.375298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c2354-6a51-4ea2-b26e-d775b710919f service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:02.382368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec1eee-ccd2-477a-af2b-3cd39017b347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:02.383089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec1eee-ccd2-477a-af2b-3cd39017b347 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:02.383373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec1eee-ccd2-477a-af2b-3cd39017b347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:02.383655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec1eee-ccd2-477a-af2b-3cd39017b347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:02.387498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-91ec1eee-ccd2-477a-af2b-3cd39017b347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:02.535649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec1eee-ccd2-477a-af2b-3cd39017b347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:02.541106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec1eee-ccd2-477a-af2b-3cd39017b347 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:02.578437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 918/1840] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:03.563925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:04.546151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:07.956950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648b4f-83ec-481e-97a8-2e688f91a8d3 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:08.029475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648b4f-83ec-481e-97a8-2e688f91a8d3 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:08.035216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:08.036111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:08.036394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:08.036667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] PATH_INFO: `/v3/users/85393ab3d5ae438e97081879dacc22e2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:08.037905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85393ab3d5ae438e97081879dacc22e2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:08.039874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:08.059337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:08.267649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85393ab3d5ae438e97081879dacc22e2'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:08.276383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85393ab3d5ae438e97081879dacc22e2'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:08.277336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85393ab3d5ae438e97081879dacc22e2'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:08.278192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85393ab3d5ae438e97081879dacc22e2'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:08.371095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85393ab3d5ae438e97081879dacc22e2'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:08.388770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 923/1841] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:07 2022] DELETE /identity/v3/users/85393ab3d5ae438e97081879dacc22e2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:08.393277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4e345-5217-44d4-b82e-771e44c1aa37 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:08.393741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4e345-5217-44d4-b82e-771e44c1aa37 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:08.393843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4e345-5217-44d4-b82e-771e44c1aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:08.411826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-89d4e345-5217-44d4-b82e-771e44c1aa37 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:08.412995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-89d4e345-5217-44d4-b82e-771e44c1aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:08.472560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 919/1842] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:08.482320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:08.483722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:08.542677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55542604-29f4-447a-b830-51c46f4dc492 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:08.546287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:08.546941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:08.547227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:08.548130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:08.557194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:08.558811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:08.568366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 924/1843] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:09.249760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4e345-5217-44d4-b82e-771e44c1aa37 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:09.252565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-89d4e345-5217-44d4-b82e-771e44c1aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:09.269582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4e345-5217-44d4-b82e-771e44c1aa37 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:09.275073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:09.276053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:09.276333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:09.276607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] PATH_INFO: `/v3/users/fde6a089eb064d9b92a1b621f2aea09f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:09.278044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde6a089eb064d9b92a1b621f2aea09f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:09.280041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:09.567175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde6a089eb064d9b92a1b621f2aea09f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.582528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde6a089eb064d9b92a1b621f2aea09f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.651338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:09.655103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:09.670874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde6a089eb064d9b92a1b621f2aea09f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.671677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde6a089eb064d9b92a1b621f2aea09f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.679574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0c4de90a-7c21-4f14-8b45-d0669541fbb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde6a089eb064d9b92a1b621f2aea09f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.682384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d237bc-1adc-4008-832e-7e3145ca39aa service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:09.700566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:09.701735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:09.702241 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:09.702664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] PATH_INFO: `/v3/projects/f6dceb5040e14b4faa5617868f4a955f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:09.704550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6dceb5040e14b4faa5617868f4a955f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:09.706764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:09.727369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 920/1844] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:09 2022] DELETE /identity/v3/users/fde6a089eb064d9b92a1b621f2aea09f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:09.731739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409426f-4093-4b9b-ad77-d899d12ad4c7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:09.732034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409426f-4093-4b9b-ad77-d899d12ad4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:09.734885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409426f-4093-4b9b-ad77-d899d12ad4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:09.792723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c409426f-4093-4b9b-ad77-d899d12ad4c7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:09.794637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c409426f-4093-4b9b-ad77-d899d12ad4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:09.847255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:09.894389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 921/1845] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:09.904562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409426f-4093-4b9b-ad77-d899d12ad4c7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:09.906917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c409426f-4093-4b9b-ad77-d899d12ad4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:09.911003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6dceb5040e14b4faa5617868f4a955f', 'request_id': 'req-fadfc629-8db9-4099-aa31-bb7604137b3b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.921515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6dceb5040e14b4faa5617868f4a955f', 'request_id': 'req-fadfc629-8db9-4099-aa31-bb7604137b3b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:09.988863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409426f-4093-4b9b-ad77-d899d12ad4c7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.002720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6dceb5040e14b4faa5617868f4a955f', 'request_id': 'req-fadfc629-8db9-4099-aa31-bb7604137b3b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.015502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] The token cache is being invalidate because project f6dceb5040e14b4faa5617868f4a955f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:10.015797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.017080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.019078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 925/1846] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:09 2022] DELETE /identity/v3/projects/f6dceb5040e14b4faa5617868f4a955f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:10.022576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.023957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.040082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:10.059875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.060507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.060797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.061077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.063930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.127166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfc629-8db9-4099-aa31-bb7604137b3b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.132855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.134149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.134435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.134714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] PATH_INFO: `/v3/users/4ec3404802a14d5080b86324fea02f40` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.135993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec3404802a14d5080b86324fea02f40)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.138307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.155204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.156859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.172110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 922/1847] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:10.174237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.176535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.194294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32cfd2-a14b-4639-904f-9ba8690dbba7 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.199674 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.201840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.202543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.203025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] PATH_INFO: `/v3/users/21f648b85bdf4eb4ac70b2167e2ccd93` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.204667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f648b85bdf4eb4ac70b2167e2ccd93)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.207417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.403736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec3404802a14d5080b86324fea02f40'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.413938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec3404802a14d5080b86324fea02f40'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.415284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec3404802a14d5080b86324fea02f40'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.415958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec3404802a14d5080b86324fea02f40'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.450708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f648b85bdf4eb4ac70b2167e2ccd93'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.464198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f648b85bdf4eb4ac70b2167e2ccd93'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.494236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-eaeca432-3c76-4eee-8c16-568b60b4c3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec3404802a14d5080b86324fea02f40'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.520336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 926/1848] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:10 2022] DELETE /identity/v3/users/4ec3404802a14d5080b86324fea02f40 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:10.615185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f648b85bdf4eb4ac70b2167e2ccd93'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.616140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f648b85bdf4eb4ac70b2167e2ccd93'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.616763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f648b85bdf4eb4ac70b2167e2ccd93'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:10.639278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 923/1849] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:10 2022] DELETE /identity/v3/users/21f648b85bdf4eb4ac70b2167e2ccd93 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:10.643528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93187a-f509-4f2c-8228-f75cacd1dab5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.644115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93187a-f509-4f2c-8228-f75cacd1dab5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.644219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93187a-f509-4f2c-8228-f75cacd1dab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.698190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-cb93187a-f509-4f2c-8228-f75cacd1dab5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:10.699569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cb93187a-f509-4f2c-8228-f75cacd1dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.767195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 927/1850] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:10.785373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:10.786994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:10.860427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df8e98-aca9-4508-bc71-478e326c72d0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:10.866950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:10.866950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:10.866950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:10.866950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:10.883294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:10.884954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:10.901992 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 924/1851] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:11.012848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93187a-f509-4f2c-8228-f75cacd1dab5 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.014479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cb93187a-f509-4f2c-8228-f75cacd1dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.028305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93187a-f509-4f2c-8228-f75cacd1dab5 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.045506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.047190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.047190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.047190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] PATH_INFO: `/v3/projects/688d3037f7d845e7bbbf7b3356fd1d5b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.048295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688d3037f7d845e7bbbf7b3356fd1d5b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.050278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.105746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.107328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.121894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f0183-7116-49c9-9ff2-23422732859f service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.127876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.128762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.129043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.129678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] PATH_INFO: `/v3/projects/6f8a43b40bd44e29958444cfa6bd9b77` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.130576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8a43b40bd44e29958444cfa6bd9b77)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.133888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.202766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688d3037f7d845e7bbbf7b3356fd1d5b', 'request_id': 'req-b705b0b4-de91-4b15-be5d-95a0fe41e545'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.209738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688d3037f7d845e7bbbf7b3356fd1d5b', 'request_id': 'req-b705b0b4-de91-4b15-be5d-95a0fe41e545'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.278092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8a43b40bd44e29958444cfa6bd9b77', 'request_id': 'req-564d1b4d-db98-4c25-8a59-fd98edbb3521'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.283835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688d3037f7d845e7bbbf7b3356fd1d5b', 'request_id': 'req-b705b0b4-de91-4b15-be5d-95a0fe41e545'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.305930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] The token cache is being invalidate because project 688d3037f7d845e7bbbf7b3356fd1d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:11.306552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.307445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.309144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 928/1852] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:11 2022] DELETE /identity/v3/projects/688d3037f7d845e7bbbf7b3356fd1d5b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:11.313548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.315339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.384616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705b0b4-de91-4b15-be5d-95a0fe41e545 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.410942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8a43b40bd44e29958444cfa6bd9b77', 'request_id': 'req-564d1b4d-db98-4c25-8a59-fd98edbb3521'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.418005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8a43b40bd44e29958444cfa6bd9b77', 'request_id': 'req-564d1b4d-db98-4c25-8a59-fd98edbb3521'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.429045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] The token cache is being invalidate because project 6f8a43b40bd44e29958444cfa6bd9b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:11.429345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.430036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-564d1b4d-db98-4c25-8a59-fd98edbb3521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.431699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 925/1853] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:11 2022] DELETE /identity/v3/projects/6f8a43b40bd44e29958444cfa6bd9b77 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:11.436321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f72d73-b555-4724-bdce-aa20096f827f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.436619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f72d73-b555-4724-bdce-aa20096f827f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.436907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f72d73-b555-4724-bdce-aa20096f827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.442834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.443467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.443757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.444156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] PATH_INFO: `/v3/users/cb5585f74142418880b2ba4bcf21c7fc` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.445384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5585f74142418880b2ba4bcf21c7fc)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.454839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.459040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e4f72d73-b555-4724-bdce-aa20096f827f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:11.460355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e4f72d73-b555-4724-bdce-aa20096f827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.476666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 926/1854] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:11.476666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f72d73-b555-4724-bdce-aa20096f827f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.476666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e4f72d73-b555-4724-bdce-aa20096f827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.486589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f72d73-b555-4724-bdce-aa20096f827f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.491354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.492275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.492510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.492782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] PATH_INFO: `/v3/projects/4d9274caaf13492a87b02f1daf501387` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.493977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9274caaf13492a87b02f1daf501387)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.495915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.656832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9274caaf13492a87b02f1daf501387', 'request_id': 'req-a32b4bf9-966f-4006-a168-12e1cbc94780'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.657597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5585f74142418880b2ba4bcf21c7fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.666709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5585f74142418880b2ba4bcf21c7fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.667551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5585f74142418880b2ba4bcf21c7fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.668390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5585f74142418880b2ba4bcf21c7fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.729080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9274caaf13492a87b02f1daf501387', 'request_id': 'req-a32b4bf9-966f-4006-a168-12e1cbc94780'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.738827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9274caaf13492a87b02f1daf501387', 'request_id': 'req-a32b4bf9-966f-4006-a168-12e1cbc94780'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.762226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] The token cache is being invalidate because project 4d9274caaf13492a87b02f1daf501387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:11.762669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.763359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a32b4bf9-966f-4006-a168-12e1cbc94780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.764948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 927/1855] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:11 2022] DELETE /identity/v3/projects/4d9274caaf13492a87b02f1daf501387 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:11.766545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470c8a-6b6e-40e8-927a-aacd8ce29e2d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.766835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470c8a-6b6e-40e8-927a-aacd8ce29e2d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.767110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a470c8a-6b6e-40e8-927a-aacd8ce29e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.785278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5585f74142418880b2ba4bcf21c7fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:11.786080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5a470c8a-6b6e-40e8-927a-aacd8ce29e2d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:11.787622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5a470c8a-6b6e-40e8-927a-aacd8ce29e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.805178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 929/1856] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:11 2022] DELETE /identity/v3/users/cb5585f74142418880b2ba4bcf21c7fc => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:11.806260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.807615 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:11.860814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 928/1857] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:11.861901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a470c8a-6b6e-40e8-927a-aacd8ce29e2d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.871967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a470c8a-6b6e-40e8-927a-aacd8ce29e2d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.919477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c0e8-3e46-49f7-8bf0-0a37448d7d97 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.925342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.926442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.926653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.926974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] PATH_INFO: `/v3/users/d8666d8b6572434a9d89caae16ab7e9e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.928238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8666d8b6572434a9d89caae16ab7e9e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.931630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.950857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.951680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.954373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.954780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.955731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:11.956010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.957688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:11.973356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 929/1858] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:11.974283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:11.984219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd241d-a923-45b0-93eb-1a2c85c8ed60 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:11.989647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fff8fa-f75a-4aaf-98c4-c7e46728e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:11.994621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fff8fa-f75a-4aaf-98c4-c7e46728e1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:11.994621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fff8fa-f75a-4aaf-98c4-c7e46728e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:11.994621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fff8fa-f75a-4aaf-98c4-c7e46728e1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:11.994621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fff8fa-f75a-4aaf-98c4-c7e46728e1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:11.994621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fff8fa-f75a-4aaf-98c4-c7e46728e1a3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:12.079899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 930/1859] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:11 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:12.084003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fff8fa-f75a-4aaf-98c4-c7e46728e1a3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:12.147058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fff8fa-f75a-4aaf-98c4-c7e46728e1a3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:12.151753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:12.152425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.152708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.152983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.153665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:12.155847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:12.177349 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8666d8b6572434a9d89caae16ab7e9e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.184649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8666d8b6572434a9d89caae16ab7e9e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.185403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8666d8b6572434a9d89caae16ab7e9e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.186143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8666d8b6572434a9d89caae16ab7e9e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.340138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 931/1860] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:12 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:12.344911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:12.346625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:12.358672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43ddb-041a-459a-a9eb-8710870d2a60 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:12.363980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:12.364636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.364921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.365196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.365950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:12.367763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:12.368300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8666d8b6572434a9d89caae16ab7e9e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.380755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 932/1861] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:12.383255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:12.385426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:12.389934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 930/1862] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:11 2022] DELETE /identity/v3/users/d8666d8b6572434a9d89caae16ab7e9e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:12.391065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:12.399700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14437b-ad0d-41ed-8832-407ed675a0b8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:12.473339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:12.477749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.477749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.477749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] PATH_INFO: `/v3/projects/8022d4aed84341ffa1228384445cb763` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.477749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8022d4aed84341ffa1228384445cb763)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:12.479363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:12.486875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6ddc6-65d5-47d0-b311-c8850463c9aa admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:12.493287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96b0f7-810c-4a75-bafe-20921860178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:12.494173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96b0f7-810c-4a75-bafe-20921860178b admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.494850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96b0f7-810c-4a75-bafe-20921860178b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.495136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96b0f7-810c-4a75-bafe-20921860178b admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.495885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96b0f7-810c-4a75-bafe-20921860178b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:12.497666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96b0f7-810c-4a75-bafe-20921860178b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:12.513315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 931/1863] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:12.517994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96b0f7-810c-4a75-bafe-20921860178b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:12.528185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96b0f7-810c-4a75-bafe-20921860178b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:12.534432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72182dc2-3b60-4d19-8142-4f6496ae8910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:12.535358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72182dc2-3b60-4d19-8142-4f6496ae8910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.535649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72182dc2-3b60-4d19-8142-4f6496ae8910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.535931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72182dc2-3b60-4d19-8142-4f6496ae8910 admin admin] PATH_INFO: `/v3/projects/42c1d69da13146eda69f95be70508054/users/92339ac4c9e342e49ed7d9c885cf105e/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.551016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72182dc2-3b60-4d19-8142-4f6496ae8910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c1d69da13146eda69f95be70508054, user_id=92339ac4c9e342e49ed7d9c885cf105e, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:12.553694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72182dc2-3b60-4d19-8142-4f6496ae8910 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:12.643483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 932/1864] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:12 2022] PUT /identity/v3/projects/42c1d69da13146eda69f95be70508054/users/92339ac4c9e342e49ed7d9c885cf105e/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:12.657097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30642-fed6-480a-b910-48ee8a0c6d2a None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.657653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30642-fed6-480a-b910-48ee8a0c6d2a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.658068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30642-fed6-480a-b910-48ee8a0c6d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.669010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8022d4aed84341ffa1228384445cb763', 'request_id': 'req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.701716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-66a30642-fed6-480a-b910-48ee8a0c6d2a None None] MFA Rules not processed for user `92339ac4c9e342e49ed7d9c885cf105e`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:12.703095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-66a30642-fed6-480a-b910-48ee8a0c6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:12.773293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 933/1865] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:12.777949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a30642-fed6-480a-b910-48ee8a0c6d2a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:12.785754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8022d4aed84341ffa1228384445cb763', 'request_id': 'req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.792419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8022d4aed84341ffa1228384445cb763', 'request_id': 'req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.803707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] The token cache is being invalidate because project 8022d4aed84341ffa1228384445cb763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:12.803997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.804687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1ca2f4ff-ac07-4ee8-a84c-0f40b05a19b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:12.809776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 933/1866] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:12 2022] DELETE /identity/v3/projects/8022d4aed84341ffa1228384445cb763 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:12.811659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfd22-979f-4033-b736-cf29e5632ef2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.812148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfd22-979f-4033-b736-cf29e5632ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.812267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfd22-979f-4033-b736-cf29e5632ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.834636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0bfbfd22-979f-4033-b736-cf29e5632ef2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:12.836163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0bfbfd22-979f-4033-b736-cf29e5632ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:12.866839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a30642-fed6-480a-b910-48ee8a0c6d2a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:12.872769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f6190-a2d6-4e7c-855c-2cd6b7997010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:12.873673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f6190-a2d6-4e7c-855c-2cd6b7997010 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.874394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f6190-a2d6-4e7c-855c-2cd6b7997010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.874687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f6190-a2d6-4e7c-855c-2cd6b7997010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.875951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f6190-a2d6-4e7c-855c-2cd6b7997010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:12.878312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f6190-a2d6-4e7c-855c-2cd6b7997010 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:12.910615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 934/1867] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:12.918538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71877ebe-299d-4522-b015-d656b80a3469 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.918831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71877ebe-299d-4522-b015-d656b80a3469 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.919162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71877ebe-299d-4522-b015-d656b80a3469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.937469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-71877ebe-299d-4522-b015-d656b80a3469 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:12.939252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-71877ebe-299d-4522-b015-d656b80a3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:12.947278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 935/1868] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:12.954594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71877ebe-299d-4522-b015-d656b80a3469 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:12.963460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71877ebe-299d-4522-b015-d656b80a3469 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:12.968149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:12.968780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:12.969165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:12.969452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:12.970212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:12.970519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:12.972130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:12.984241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 936/1869] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:16:12.994630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:12.996322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:13.012048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a898d-5c71-427e-9864-7e91ab728e8d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.016925 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 934/1870] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:12 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:13.017900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f6190-a2d6-4e7c-855c-2cd6b7997010 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.021599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.022518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.022807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.023148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] PATH_INFO: `/v3/projects/0302fbdc165d4d3e8e9b5ef040f77016` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.024779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0302fbdc165d4d3e8e9b5ef040f77016)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.026494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.091079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f6190-a2d6-4e7c-855c-2cd6b7997010 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.095790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.096449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.096740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.097022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.097755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.099751 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.185386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0302fbdc165d4d3e8e9b5ef040f77016', 'request_id': 'req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:13.198014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 935/1871] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:13 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:13.198896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.200495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:13.262310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f5383-52ec-4eb2-a54f-fc03cd80a07f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.267065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c7b69-323e-4eb9-bf2f-af950bef1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.267730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c7b69-323e-4eb9-bf2f-af950bef1c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.268101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c7b69-323e-4eb9-bf2f-af950bef1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.268322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c7b69-323e-4eb9-bf2f-af950bef1c37 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.269004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c7b69-323e-4eb9-bf2f-af950bef1c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.270965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c7b69-323e-4eb9-bf2f-af950bef1c37 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.316563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0302fbdc165d4d3e8e9b5ef040f77016', 'request_id': 'req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:13.325365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0302fbdc165d4d3e8e9b5ef040f77016', 'request_id': 'req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:13.335801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] The token cache is being invalidate because project 0302fbdc165d4d3e8e9b5ef040f77016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:13.336092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:13.336743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:13.338447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 937/1872] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:12 2022] DELETE /identity/v3/projects/0302fbdc165d4d3e8e9b5ef040f77016 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:13.339196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.340495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:13.404868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab0c94-a779-4c7b-a8bf-b609037d0eb3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.409686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fcc53-bee1-4f2f-9542-09a933ce0acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.410375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcc53-bee1-4f2f-9542-09a933ce0acc admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.410655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcc53-bee1-4f2f-9542-09a933ce0acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.410925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcc53-bee1-4f2f-9542-09a933ce0acc admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.411603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fcc53-bee1-4f2f-9542-09a933ce0acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.413664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fcc53-bee1-4f2f-9542-09a933ce0acc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.420540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 936/1873] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:13 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:13.421876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b856-556b-4912-8f55-074aa993a112 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.422846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b856-556b-4912-8f55-074aa993a112 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.423139 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77b856-556b-4912-8f55-074aa993a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.442203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2a77b856-556b-4912-8f55-074aa993a112 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:13.443354 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2a77b856-556b-4912-8f55-074aa993a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:13.464630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 937/1874] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:13.465720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77b856-556b-4912-8f55-074aa993a112 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.473812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2a77b856-556b-4912-8f55-074aa993a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:13.487866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77b856-556b-4912-8f55-074aa993a112 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.503474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c1c8-dd1c-41fc-9b4f-acc309f36989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.504769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c1c8-dd1c-41fc-9b4f-acc309f36989 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.514413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c1c8-dd1c-41fc-9b4f-acc309f36989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.514413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c1c8-dd1c-41fc-9b4f-acc309f36989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.514413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387c1c8-dd1c-41fc-9b4f-acc309f36989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.514413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387c1c8-dd1c-41fc-9b4f-acc309f36989 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.514978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 938/1875] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:13 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:13.514978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fb5db-7e8a-40a5-8f8c-da3bc27856c6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.514978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fb5db-7e8a-40a5-8f8c-da3bc27856c6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.514978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fb5db-7e8a-40a5-8f8c-da3bc27856c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.524695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 938/1876] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:13.526440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c1c8-dd1c-41fc-9b4f-acc309f36989 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.540050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c1c8-dd1c-41fc-9b4f-acc309f36989 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.541596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9e8fb5db-7e8a-40a5-8f8c-da3bc27856c6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:13.543276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9e8fb5db-7e8a-40a5-8f8c-da3bc27856c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:13.546605 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5084e83-add7-4db6-8718-e6f00e4f9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.548274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084e83-add7-4db6-8718-e6f00e4f9e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.548643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084e83-add7-4db6-8718-e6f00e4f9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.548939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084e83-add7-4db6-8718-e6f00e4f9e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.549769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5084e83-add7-4db6-8718-e6f00e4f9e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.552848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5084e83-add7-4db6-8718-e6f00e4f9e0a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.555363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 939/1877] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:13.556661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fb5db-7e8a-40a5-8f8c-da3bc27856c6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.569163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 939/1878] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:13.569780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fb5db-7e8a-40a5-8f8c-da3bc27856c6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.570491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5084e83-add7-4db6-8718-e6f00e4f9e0a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.578730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53908a82-e83f-48c3-9102-5b26f905d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.579799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53908a82-e83f-48c3-9102-5b26f905d6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.580294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53908a82-e83f-48c3-9102-5b26f905d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.580772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53908a82-e83f-48c3-9102-5b26f905d6f7 admin admin] PATH_INFO: `/v3/projects/d480d1ef18294db69280efc0701bb7f9/users/e64930c89d1d48d193637ec1fc201bcd/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.583871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5084e83-add7-4db6-8718-e6f00e4f9e0a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.591880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.592537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.592831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.593393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.594541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:13.594908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.596609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.602112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53908a82-e83f-48c3-9102-5b26f905d6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d480d1ef18294db69280efc0701bb7f9, user_id=e64930c89d1d48d193637ec1fc201bcd, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.604929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53908a82-e83f-48c3-9102-5b26f905d6f7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.611814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 940/1879] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:13.612505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.622541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910eae5-5596-4a0e-99fc-969dc67c7fa2 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.627214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c1a1-2f7b-4d20-a6fd-cb45cc89d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.627873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c1a1-2f7b-4d20-a6fd-cb45cc89d5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.628166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c1a1-2f7b-4d20-a6fd-cb45cc89d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.628451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c1a1-2f7b-4d20-a6fd-cb45cc89d5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.629186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c1a1-2f7b-4d20-a6fd-cb45cc89d5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.630926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c1a1-2f7b-4d20-a6fd-cb45cc89d5a5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.642211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 941/1880] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:13.643014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c1a1-2f7b-4d20-a6fd-cb45cc89d5a5 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.652735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c1a1-2f7b-4d20-a6fd-cb45cc89d5a5 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.658243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d403d-1b66-43b2-ac8f-1b2d2aef3da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.658927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d403d-1b66-43b2-ac8f-1b2d2aef3da6 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.659480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d403d-1b66-43b2-ac8f-1b2d2aef3da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.663506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d403d-1b66-43b2-ac8f-1b2d2aef3da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.663506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d403d-1b66-43b2-ac8f-1b2d2aef3da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.663506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d403d-1b66-43b2-ac8f-1b2d2aef3da6 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.717073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 940/1881] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:13 2022] PUT /identity/v3/projects/d480d1ef18294db69280efc0701bb7f9/users/e64930c89d1d48d193637ec1fc201bcd/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:13.718106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53908a82-e83f-48c3-9102-5b26f905d6f7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.759205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 942/1882] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:13 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:13.760289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d403d-1b66-43b2-ac8f-1b2d2aef3da6 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.790989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53908a82-e83f-48c3-9102-5b26f905d6f7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.834699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d403d-1b66-43b2-ac8f-1b2d2aef3da6 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.840005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7e43e-8db9-4a12-af65-cfc32ec9f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.840708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7e43e-8db9-4a12-af65-cfc32ec9f37b admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.841043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7e43e-8db9-4a12-af65-cfc32ec9f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.841389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7e43e-8db9-4a12-af65-cfc32ec9f37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.842102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7e43e-8db9-4a12-af65-cfc32ec9f37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.842850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:13.843725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7e43e-8db9-4a12-af65-cfc32ec9f37b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.861073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 943/1883] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:13.861073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7e43e-8db9-4a12-af65-cfc32ec9f37b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:13.863451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa6772-0802-4f34-ad85-ab9e3350bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.864490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa6772-0802-4f34-ad85-ab9e3350bfe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.866079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa6772-0802-4f34-ad85-ab9e3350bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.866079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa6772-0802-4f34-ad85-ab9e3350bfe7 admin admin] PATH_INFO: `/v3/projects/3cc2cf090aeb44e5b00a59c6a51388f0/users/f263e26516094af598df2591f0829072/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.871815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7e43e-8db9-4a12-af65-cfc32ec9f37b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:13.877864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c23f60-e481-4639-94b7-cec321fd6fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:13.878636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c23f60-e481-4639-94b7-cec321fd6fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:13.879121 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c23f60-e481-4639-94b7-cec321fd6fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:13.879408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c23f60-e481-4639-94b7-cec321fd6fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:13.880171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c23f60-e481-4639-94b7-cec321fd6fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.881779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa6772-0802-4f34-ad85-ab9e3350bfe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc2cf090aeb44e5b00a59c6a51388f0, user_id=f263e26516094af598df2591f0829072, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:13.882335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c23f60-e481-4639-94b7-cec321fd6fcb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.885245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa6772-0802-4f34-ad85-ab9e3350bfe7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:13.997722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 941/1884] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:13 2022] PUT /identity/v3/projects/3cc2cf090aeb44e5b00a59c6a51388f0/users/f263e26516094af598df2591f0829072/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:13.998691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa6772-0802-4f34-ad85-ab9e3350bfe7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.016197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 944/1885] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:13 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:14.017922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44097-b1a0-410e-ae39-a103a3ea8956 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.021317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44097-b1a0-410e-ae39-a103a3ea8956 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.021317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44097-b1a0-410e-ae39-a103a3ea8956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.050765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b2b44097-b1a0-410e-ae39-a103a3ea8956 None None] MFA Rules not processed for user `f263e26516094af598df2591f0829072`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:14.052196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b2b44097-b1a0-410e-ae39-a103a3ea8956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:14.060405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:14.077857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa6772-0802-4f34-ad85-ab9e3350bfe7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.082881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7996d3-c9f2-4869-9c1b-43a6d12e7447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.083929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7996d3-c9f2-4869-9c1b-43a6d12e7447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.084255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7996d3-c9f2-4869-9c1b-43a6d12e7447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.084607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7996d3-c9f2-4869-9c1b-43a6d12e7447 admin admin] PATH_INFO: `/v3/projects/d480d1ef18294db69280efc0701bb7f9/users/e64930c89d1d48d193637ec1fc201bcd/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.086913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7996d3-c9f2-4869-9c1b-43a6d12e7447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d480d1ef18294db69280efc0701bb7f9, user_id=e64930c89d1d48d193637ec1fc201bcd, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.090021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7996d3-c9f2-4869-9c1b-43a6d12e7447 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.101295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 942/1886] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:13 2022] PUT /identity/v3/projects/d480d1ef18294db69280efc0701bb7f9/users/e64930c89d1d48d193637ec1fc201bcd/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:14.107179 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7996d3-c9f2-4869-9c1b-43a6d12e7447 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.122846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 945/1887] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:14.124158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161cd7a-bc20-4700-b696-ecf513a5522b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.124451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161cd7a-bc20-4700-b696-ecf513a5522b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.124736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161cd7a-bc20-4700-b696-ecf513a5522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.153004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d161cd7a-bc20-4700-b696-ecf513a5522b None None] MFA Rules not processed for user `e64930c89d1d48d193637ec1fc201bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:14.154290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d161cd7a-bc20-4700-b696-ecf513a5522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:14.184130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7996d3-c9f2-4869-9c1b-43a6d12e7447 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.190380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f970-6dc8-4f10-babf-91f75a729fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.191190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f970-6dc8-4f10-babf-91f75a729fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.192028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f970-6dc8-4f10-babf-91f75a729fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.192389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f970-6dc8-4f10-babf-91f75a729fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.193232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f970-6dc8-4f10-babf-91f75a729fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.195334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f970-6dc8-4f10-babf-91f75a729fa3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.209806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 943/1888] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:14.210933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f970-6dc8-4f10-babf-91f75a729fa3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.221866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f970-6dc8-4f10-babf-91f75a729fa3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.227358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6774-00d7-49e6-a341-92d13db7954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.228034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6774-00d7-49e6-a341-92d13db7954e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.228390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6774-00d7-49e6-a341-92d13db7954e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.229929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6774-00d7-49e6-a341-92d13db7954e admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.229929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d6774-00d7-49e6-a341-92d13db7954e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.231834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d6774-00d7-49e6-a341-92d13db7954e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.259179 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 946/1889] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:14.260287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161cd7a-bc20-4700-b696-ecf513a5522b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.271481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161cd7a-bc20-4700-b696-ecf513a5522b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.276248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.276921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.277212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.278103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.278250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.279870 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.291246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 947/1890] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:14.292215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.295757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:14.358396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea33a3-c595-43a0-8155-9d29c4accee7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.362810 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a35ea-4722-4be0-a0e4-020779dd39ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.363544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a35ea-4722-4be0-a0e4-020779dd39ec service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.363847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a35ea-4722-4be0-a0e4-020779dd39ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.364167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a35ea-4722-4be0-a0e4-020779dd39ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.368324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 944/1891] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:14 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:14.368324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6774-00d7-49e6-a341-92d13db7954e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.377321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a35ea-4722-4be0-a0e4-020779dd39ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.379444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a35ea-4722-4be0-a0e4-020779dd39ec service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.391258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 948/1892] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:14.392262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a35ea-4722-4be0-a0e4-020779dd39ec service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.404113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a35ea-4722-4be0-a0e4-020779dd39ec service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.443007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6774-00d7-49e6-a341-92d13db7954e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.453067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f348c2-9958-488c-9f39-746cb2fbdf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.454366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f348c2-9958-488c-9f39-746cb2fbdf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.454810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f348c2-9958-488c-9f39-746cb2fbdf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.455388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f348c2-9958-488c-9f39-746cb2fbdf20 admin admin] PATH_INFO: `/v3/projects/963eee45a9944ae58adc9208d2a4d958/users/55969fee95424c41a04ccfc954363979/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.473050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f348c2-9958-488c-9f39-746cb2fbdf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=963eee45a9944ae58adc9208d2a4d958, user_id=55969fee95424c41a04ccfc954363979, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.475865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f348c2-9958-488c-9f39-746cb2fbdf20 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.502631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70e817-11ea-4ffd-a74e-b2b58a38616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.503277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e817-11ea-4ffd-a74e-b2b58a38616d admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.503567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e817-11ea-4ffd-a74e-b2b58a38616d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.503844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70e817-11ea-4ffd-a74e-b2b58a38616d admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.504540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70e817-11ea-4ffd-a74e-b2b58a38616d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.506761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70e817-11ea-4ffd-a74e-b2b58a38616d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.591812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 945/1893] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:14 2022] PUT /identity/v3/projects/963eee45a9944ae58adc9208d2a4d958/users/55969fee95424c41a04ccfc954363979/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:14.592820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f348c2-9958-488c-9f39-746cb2fbdf20 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.648234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f348c2-9958-488c-9f39-746cb2fbdf20 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.652695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 949/1894] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:14 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:14.652695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e345-c997-48cc-aade-3e7876ff3f75 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.652695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e345-c997-48cc-aade-3e7876ff3f75 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.652695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e345-c997-48cc-aade-3e7876ff3f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.655442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.656178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.657001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.657289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.659535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:14.683855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-fcb8e345-c997-48cc-aade-3e7876ff3f75 None None] MFA Rules not processed for user `55969fee95424c41a04ccfc954363979`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:14.685195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-fcb8e345-c997-48cc-aade-3e7876ff3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:14.749947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.753053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.770128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 946/1895] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:14.771329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.784221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 950/1896] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:14.788987 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8e345-c997-48cc-aade-3e7876ff3f75 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.847840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:14.854909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105d88d-68fc-4191-99ad-84ee4c55527c service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.861142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b27d0-138e-4992-9eed-08597c165a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.862067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b27d0-138e-4992-9eed-08597c165a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.862496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b27d0-138e-4992-9eed-08597c165a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.862919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b27d0-138e-4992-9eed-08597c165a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.863799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b27d0-138e-4992-9eed-08597c165a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.866365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b27d0-138e-4992-9eed-08597c165a32 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.880789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 947/1897] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:14.881945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8e345-c997-48cc-aade-3e7876ff3f75 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.885772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b27d0-138e-4992-9eed-08597c165a32 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:14.892714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62684c8-94aa-4386-992e-877b55416260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.893411 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62684c8-94aa-4386-992e-877b55416260 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.893759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62684c8-94aa-4386-992e-877b55416260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.894176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62684c8-94aa-4386-992e-877b55416260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.894814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62684c8-94aa-4386-992e-877b55416260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.897158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62684c8-94aa-4386-992e-877b55416260 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:14.900976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b27d0-138e-4992-9eed-08597c165a32 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:14.910260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413708d-1d00-4da5-b7ef-b82cb0d0f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:14.911503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413708d-1d00-4da5-b7ef-b82cb0d0f101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:14.912106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413708d-1d00-4da5-b7ef-b82cb0d0f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:14.912570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413708d-1d00-4da5-b7ef-b82cb0d0f101 admin admin] PATH_INFO: `/v3/projects/5df8b0f5a580461d9107fee83ea4d895/users/d06aaf8543e346d588523c1ecf611fc9/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:14.934678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413708d-1d00-4da5-b7ef-b82cb0d0f101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df8b0f5a580461d9107fee83ea4d895, user_id=d06aaf8543e346d588523c1ecf611fc9, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:14.939082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413708d-1d00-4da5-b7ef-b82cb0d0f101 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.009950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 951/1898] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:14 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:15.013910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62684c8-94aa-4386-992e-877b55416260 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.039286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 948/1899] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:14 2022] PUT /identity/v3/projects/5df8b0f5a580461d9107fee83ea4d895/users/d06aaf8543e346d588523c1ecf611fc9/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:15.043968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413708d-1d00-4da5-b7ef-b82cb0d0f101 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.089367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62684c8-94aa-4386-992e-877b55416260 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.149281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413708d-1d00-4da5-b7ef-b82cb0d0f101 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.153995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26b693-b066-42a6-bdfb-58d1db329c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.154672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26b693-b066-42a6-bdfb-58d1db329c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.154958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26b693-b066-42a6-bdfb-58d1db329c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.155239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26b693-b066-42a6-bdfb-58d1db329c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.155965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26b693-b066-42a6-bdfb-58d1db329c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.158170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26b693-b066-42a6-bdfb-58d1db329c2c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.159370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1d30d-c7a1-44f4-89e0-f6f651782207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.160051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1d30d-c7a1-44f4-89e0-f6f651782207 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.160346 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1d30d-c7a1-44f4-89e0-f6f651782207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.160684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1d30d-c7a1-44f4-89e0-f6f651782207 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.161379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1d30d-c7a1-44f4-89e0-f6f651782207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.163334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1d30d-c7a1-44f4-89e0-f6f651782207 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.168496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 949/1900] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:15.173183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26b693-b066-42a6-bdfb-58d1db329c2c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.183369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26b693-b066-42a6-bdfb-58d1db329c2c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.188035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469a430-27c5-470c-9287-9e2e2232c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.188907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a430-27c5-470c-9287-9e2e2232c467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.189194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a430-27c5-470c-9287-9e2e2232c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.189476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a430-27c5-470c-9287-9e2e2232c467 admin admin] PATH_INFO: `/v3/projects/5df8b0f5a580461d9107fee83ea4d895/users/d06aaf8543e346d588523c1ecf611fc9/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.191506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469a430-27c5-470c-9287-9e2e2232c467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df8b0f5a580461d9107fee83ea4d895, user_id=d06aaf8543e346d588523c1ecf611fc9, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.194174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469a430-27c5-470c-9287-9e2e2232c467 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.204155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 950/1901] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:15 2022] PUT /identity/v3/projects/5df8b0f5a580461d9107fee83ea4d895/users/d06aaf8543e346d588523c1ecf611fc9/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:15.215045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79c9e-3def-474d-b5fc-992dbed329cb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.215343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79c9e-3def-474d-b5fc-992dbed329cb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.215659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79c9e-3def-474d-b5fc-992dbed329cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.251967 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 952/1902] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:15 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:15.252853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7ff79c9e-3def-474d-b5fc-992dbed329cb None None] MFA Rules not processed for user `d06aaf8543e346d588523c1ecf611fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:15.254111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1d30d-c7a1-44f4-89e0-f6f651782207 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.254333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7ff79c9e-3def-474d-b5fc-992dbed329cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:15.273189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1d30d-c7a1-44f4-89e0-f6f651782207 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.331334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 951/1903] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:15.342758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eb909-9ed6-41ac-b9fa-65d4a596aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.343524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eb909-9ed6-41ac-b9fa-65d4a596aa69 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.344272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eb909-9ed6-41ac-b9fa-65d4a596aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.344550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eb909-9ed6-41ac-b9fa-65d4a596aa69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.346734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eb909-9ed6-41ac-b9fa-65d4a596aa69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.348522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79c9e-3def-474d-b5fc-992dbed329cb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.348648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8eb909-9ed6-41ac-b9fa-65d4a596aa69 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.350483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7ff79c9e-3def-474d-b5fc-992dbed329cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:15.363164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 953/1904] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:15.368385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eb909-9ed6-41ac-b9fa-65d4a596aa69 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.385017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eb909-9ed6-41ac-b9fa-65d4a596aa69 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.390202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f3fe-9e6b-4812-b1bd-250978147190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.390912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f3fe-9e6b-4812-b1bd-250978147190 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.391207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f3fe-9e6b-4812-b1bd-250978147190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.391507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628f3fe-9e6b-4812-b1bd-250978147190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.392229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628f3fe-9e6b-4812-b1bd-250978147190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.393875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628f3fe-9e6b-4812-b1bd-250978147190 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.405418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 954/1905] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:15.410520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f3fe-9e6b-4812-b1bd-250978147190 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.422801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628f3fe-9e6b-4812-b1bd-250978147190 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.428587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863d29-fec4-47dd-915c-d92e66a114eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.430344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863d29-fec4-47dd-915c-d92e66a114eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.430517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863d29-fec4-47dd-915c-d92e66a114eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.430906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863d29-fec4-47dd-915c-d92e66a114eb admin admin] PATH_INFO: `/v3/projects/260ab45f7ae548e290183948ff3b1da2/users/e8fa5b0ca538445da578a9e8f0295f36/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.435185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79c9e-3def-474d-b5fc-992dbed329cb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.439177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ae371-0f67-4a39-b17f-bbf684b79a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.440026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae371-0f67-4a39-b17f-bbf684b79a99 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.440436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae371-0f67-4a39-b17f-bbf684b79a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.440727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae371-0f67-4a39-b17f-bbf684b79a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.456679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25863d29-fec4-47dd-915c-d92e66a114eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=260ab45f7ae548e290183948ff3b1da2, user_id=e8fa5b0ca538445da578a9e8f0295f36, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.459850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25863d29-fec4-47dd-915c-d92e66a114eb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.517233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ae371-0f67-4a39-b17f-bbf684b79a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.519139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ae371-0f67-4a39-b17f-bbf684b79a99 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.534904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 955/1906] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:15 2022] PUT /identity/v3/projects/260ab45f7ae548e290183948ff3b1da2/users/e8fa5b0ca538445da578a9e8f0295f36/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:15.539953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 952/1907] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:15.545165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90d29-4607-4333-b202-8cfa6becd00d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.545343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90d29-4607-4333-b202-8cfa6becd00d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.545767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f90d29-4607-4333-b202-8cfa6becd00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.582607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c3f90d29-4607-4333-b202-8cfa6becd00d None None] MFA Rules not processed for user `e8fa5b0ca538445da578a9e8f0295f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:15.583901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c3f90d29-4607-4333-b202-8cfa6becd00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:15.645536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:15.666512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 956/1908] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:15.671336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ae371-0f67-4a39-b17f-bbf684b79a99 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.683106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ae371-0f67-4a39-b17f-bbf684b79a99 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:15.782262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998eb7d-1295-4c73-b70e-2c3014f3da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:15.783043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998eb7d-1295-4c73-b70e-2c3014f3da67 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:15.783327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998eb7d-1295-4c73-b70e-2c3014f3da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:15.783739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998eb7d-1295-4c73-b70e-2c3014f3da67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:15.784972 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998eb7d-1295-4c73-b70e-2c3014f3da67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:15.787259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998eb7d-1295-4c73-b70e-2c3014f3da67 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:15.919134 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 953/1909] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:15 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:15.923209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f90d29-4607-4333-b202-8cfa6becd00d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:15.935520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f90d29-4607-4333-b202-8cfa6becd00d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:16.071631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b06c7c-de84-45ec-9b31-d47a438a4e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:16.072387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06c7c-de84-45ec-9b31-d47a438a4e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:16.072683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06c7c-de84-45ec-9b31-d47a438a4e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:16.073011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b06c7c-de84-45ec-9b31-d47a438a4e67 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:16.073893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b06c7c-de84-45ec-9b31-d47a438a4e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:16.076094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b06c7c-de84-45ec-9b31-d47a438a4e67 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:16.187664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 957/1910] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:15 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:16.194552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998eb7d-1295-4c73-b70e-2c3014f3da67 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:16.206834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998eb7d-1295-4c73-b70e-2c3014f3da67 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:16.211403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a8e7-7e93-457f-b943-eec9f13ece09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:16.212085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a8e7-7e93-457f-b943-eec9f13ece09 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:16.212373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a8e7-7e93-457f-b943-eec9f13ece09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:16.214788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a8e7-7e93-457f-b943-eec9f13ece09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:16.214788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2a8e7-7e93-457f-b943-eec9f13ece09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:16.214985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2a8e7-7e93-457f-b943-eec9f13ece09 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:16.226024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 954/1911] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:16.230357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b06c7c-de84-45ec-9b31-d47a438a4e67 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:16.251071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b06c7c-de84-45ec-9b31-d47a438a4e67 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:16.255910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3df27-1c3d-4b53-8470-65b38cfb6b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:16.256859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3df27-1c3d-4b53-8470-65b38cfb6b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:16.257193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3df27-1c3d-4b53-8470-65b38cfb6b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:16.257488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3df27-1c3d-4b53-8470-65b38cfb6b7f admin admin] PATH_INFO: `/v3/projects/b253f07072924683a9d4985d4ca7e8f2/users/d1956b35834342a39579b65d24b7881e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:16.266623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:16.274609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3df27-1c3d-4b53-8470-65b38cfb6b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b253f07072924683a9d4985d4ca7e8f2, user_id=d1956b35834342a39579b65d24b7881e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:16.277404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3df27-1c3d-4b53-8470-65b38cfb6b7f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:16.422436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 958/1912] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:16 2022] PUT /identity/v3/projects/b253f07072924683a9d4985d4ca7e8f2/users/d1956b35834342a39579b65d24b7881e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:16.426628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a8e7-7e93-457f-b943-eec9f13ece09 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:16.437239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a8e7-7e93-457f-b943-eec9f13ece09 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:16.523720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263d8e-0d66-42cd-9535-0c6a5d7040e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:16.524742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263d8e-0d66-42cd-9535-0c6a5d7040e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:16.525065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263d8e-0d66-42cd-9535-0c6a5d7040e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:16.525455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263d8e-0d66-42cd-9535-0c6a5d7040e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:16.526467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b263d8e-0d66-42cd-9535-0c6a5d7040e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:16.528461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b263d8e-0d66-42cd-9535-0c6a5d7040e8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:16.552920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 955/1913] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:16.554141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3df27-1c3d-4b53-8470-65b38cfb6b7f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:16.568588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3df27-1c3d-4b53-8470-65b38cfb6b7f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:16.573470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a752ad-a828-4660-a247-2da218cc6dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:16.574406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a752ad-a828-4660-a247-2da218cc6dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:16.574696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a752ad-a828-4660-a247-2da218cc6dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:16.574977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a752ad-a828-4660-a247-2da218cc6dd1 admin admin] PATH_INFO: `/v3/projects/b253f07072924683a9d4985d4ca7e8f2/users/d1956b35834342a39579b65d24b7881e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:16.578924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a752ad-a828-4660-a247-2da218cc6dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b253f07072924683a9d4985d4ca7e8f2, user_id=d1956b35834342a39579b65d24b7881e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:16.581611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a752ad-a828-4660-a247-2da218cc6dd1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:16.605439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 959/1914] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:16 2022] PUT /identity/v3/projects/b253f07072924683a9d4985d4ca7e8f2/users/d1956b35834342a39579b65d24b7881e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:16.617425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82dd31-b0a0-4825-80a0-1d65ad547ae9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:16.618056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82dd31-b0a0-4825-80a0-1d65ad547ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:16.618373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82dd31-b0a0-4825-80a0-1d65ad547ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:16.653829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-dd82dd31-b0a0-4825-80a0-1d65ad547ae9 None None] MFA Rules not processed for user `d1956b35834342a39579b65d24b7881e`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:16.663919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dd82dd31-b0a0-4825-80a0-1d65ad547ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:16.841620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 956/1915] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:16.858307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a752ad-a828-4660-a247-2da218cc6dd1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:16.977752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a752ad-a828-4660-a247-2da218cc6dd1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:16.989705 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7d396-9bbc-48b8-9a92-d9fd2c901467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:16.992928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7d396-9bbc-48b8-9a92-d9fd2c901467 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:16.993221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7d396-9bbc-48b8-9a92-d9fd2c901467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:16.993503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7d396-9bbc-48b8-9a92-d9fd2c901467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:17.077553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7d396-9bbc-48b8-9a92-d9fd2c901467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:17.080335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7d396-9bbc-48b8-9a92-d9fd2c901467 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:17.096080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 960/1916] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:17.101485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:17.523863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:18.465376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:18.604282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82dd31-b0a0-4825-80a0-1d65ad547ae9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:18.612514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82dd31-b0a0-4825-80a0-1d65ad547ae9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:18.615882 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947e8d-e33f-405f-af89-6970122e5c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:18.616545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947e8d-e33f-405f-af89-6970122e5c0c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:18.616828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947e8d-e33f-405f-af89-6970122e5c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:18.617116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947e8d-e33f-405f-af89-6970122e5c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:18.685092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947e8d-e33f-405f-af89-6970122e5c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:18.686539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947e8d-e33f-405f-af89-6970122e5c0c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:18.696786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 957/1917] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:18.963220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:19.254128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:19.351690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7d396-9bbc-48b8-9a92-d9fd2c901467 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:19.414898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7d396-9bbc-48b8-9a92-d9fd2c901467 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:19.419477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:19.420347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:19.420637 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:19.420921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] PATH_INFO: `/v3/users/92339ac4c9e342e49ed7d9c885cf105e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:19.422208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92339ac4c9e342e49ed7d9c885cf105e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:19.424170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:19.650456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92339ac4c9e342e49ed7d9c885cf105e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:19.658360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92339ac4c9e342e49ed7d9c885cf105e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:19.659301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92339ac4c9e342e49ed7d9c885cf105e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:19.659917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92339ac4c9e342e49ed7d9c885cf105e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:19.773120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92339ac4c9e342e49ed7d9c885cf105e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:19.792602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 961/1918] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:19 2022] DELETE /identity/v3/users/92339ac4c9e342e49ed7d9c885cf105e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:19.797116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbcf7-f95a-4add-aa49-c54239e78744 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:19.797710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbcf7-f95a-4add-aa49-c54239e78744 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:19.797710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadbcf7-f95a-4add-aa49-c54239e78744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:19.815796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9dadbcf7-f95a-4add-aa49-c54239e78744 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:19.816907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9dadbcf7-f95a-4add-aa49-c54239e78744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:19.874356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 958/1919] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:19.884057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:19.885487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:19.905792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:19.949238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f23db-94b7-4b15-9b80-a4ebd0488446 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:19.953160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:19.953999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:19.955701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:19.955701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:19.966518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:19.968156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:19.979888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 962/1920] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:20.060200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:20.669341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadbcf7-f95a-4add-aa49-c54239e78744 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:20.670804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9dadbcf7-f95a-4add-aa49-c54239e78744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:20.735153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadbcf7-f95a-4add-aa49-c54239e78744 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:20.739431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:20.744213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:20.744213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:20.744213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:20.744213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:20.781936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:20.783664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:20.802175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce97cd-a7a9-4b93-a756-66f91a7d7597 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:20.805999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:20.807023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:20.807307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:20.807591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] PATH_INFO: `/v3/projects/42c1d69da13146eda69f95be70508054` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:20.808898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c1d69da13146eda69f95be70508054)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:20.810971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:20.841577 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:20.843182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:20.856034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 959/1921] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:20.865625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:20.968135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c1d69da13146eda69f95be70508054', 'request_id': 'req-89148afc-4e8d-4f12-ae89-adb1cafbf302'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:20.969413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c1d69da13146eda69f95be70508054', 'request_id': 'req-89148afc-4e8d-4f12-ae89-adb1cafbf302'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.065045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c1d69da13146eda69f95be70508054', 'request_id': 'req-89148afc-4e8d-4f12-ae89-adb1cafbf302'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.071481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:21.081837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] The token cache is being invalidate because project 42c1d69da13146eda69f95be70508054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:21.084946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.084946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.084946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 963/1922] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:20 2022] DELETE /identity/v3/projects/42c1d69da13146eda69f95be70508054 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:21.088322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:21.098748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbec09-77d4-4c49-b415-d57aa4ae23de service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:21.154675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:21.155558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:21.155847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:21.156145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] PATH_INFO: `/v3/users/e64930c89d1d48d193637ec1fc201bcd` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:21.157463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64930c89d1d48d193637ec1fc201bcd)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:21.159814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:21.445737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64930c89d1d48d193637ec1fc201bcd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.452898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64930c89d1d48d193637ec1fc201bcd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.540571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64930c89d1d48d193637ec1fc201bcd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.541312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64930c89d1d48d193637ec1fc201bcd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.542019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9fa45100-859f-4be4-9ae2-53e81ea50174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64930c89d1d48d193637ec1fc201bcd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:21.568160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 960/1923] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:21 2022] DELETE /identity/v3/users/e64930c89d1d48d193637ec1fc201bcd => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:21.859566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:22.135242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:22.136856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:22.161341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148afc-4e8d-4f12-ae89-adb1cafbf302 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:22.255621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:22.288958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:22.289857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:22.290178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:22.290461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] PATH_INFO: `/v3/projects/d480d1ef18294db69280efc0701bb7f9` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:22.298944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d480d1ef18294db69280efc0701bb7f9)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:22.301442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:22.452297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd480d1ef18294db69280efc0701bb7f9', 'request_id': 'req-0ff9dcee-429f-4520-80da-9f998ad76fd6'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:22.459078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd480d1ef18294db69280efc0701bb7f9', 'request_id': 'req-0ff9dcee-429f-4520-80da-9f998ad76fd6'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:22.561303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd480d1ef18294db69280efc0701bb7f9', 'request_id': 'req-0ff9dcee-429f-4520-80da-9f998ad76fd6'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:22.575385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] The token cache is being invalidate because project d480d1ef18294db69280efc0701bb7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:22.575684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:22.576778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0ff9dcee-429f-4520-80da-9f998ad76fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:22.582277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 964/1924] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:22 2022] DELETE /identity/v3/projects/d480d1ef18294db69280efc0701bb7f9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:22.584291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57deb09-de2e-4ef6-baf6-9e1a7cc8f195 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:22.584770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57deb09-de2e-4ef6-baf6-9e1a7cc8f195 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:22.585244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57deb09-de2e-4ef6-baf6-9e1a7cc8f195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:22.622344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a57deb09-de2e-4ef6-baf6-9e1a7cc8f195 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:22.623707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a57deb09-de2e-4ef6-baf6-9e1a7cc8f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:22.722537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 961/1925] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:22.731520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e9b5-ff7b-4c02-8ed4-ff70d9c3037f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:22.731875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e9b5-ff7b-4c02-8ed4-ff70d9c3037f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:22.732103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e9b5-ff7b-4c02-8ed4-ff70d9c3037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:22.755468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-61e9e9b5-ff7b-4c02-8ed4-ff70d9c3037f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:22.756747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-61e9e9b5-ff7b-4c02-8ed4-ff70d9c3037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:22.763923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57deb09-de2e-4ef6-baf6-9e1a7cc8f195 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:22.765302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a57deb09-de2e-4ef6-baf6-9e1a7cc8f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:22.774301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 965/1926] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:22.776332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9e9b5-ff7b-4c02-8ed4-ff70d9c3037f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:22.787668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9e9b5-ff7b-4c02-8ed4-ff70d9c3037f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:22.802324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:22.804159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:22.804708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:22.805699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:22.806854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:22.808048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:22.810626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:22.834908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 966/1927] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:16:22.836400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:22.850227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc42f7-e625-4a15-bb74-8f18ac4ddf64 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:22.856057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dabd61-0266-4282-ac0c-178b9c05df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:22.857082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dabd61-0266-4282-ac0c-178b9c05df41 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:22.857547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dabd61-0266-4282-ac0c-178b9c05df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:22.857831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dabd61-0266-4282-ac0c-178b9c05df41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:22.858581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dabd61-0266-4282-ac0c-178b9c05df41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:22.861440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dabd61-0266-4282-ac0c-178b9c05df41 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:22.878820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57deb09-de2e-4ef6-baf6-9e1a7cc8f195 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:22.878820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:22.878820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:22.878820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:22.879150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:22.879150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:22.943824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:22.950886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:22.954539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 962/1928] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:22.987098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:22.989098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 967/1929] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:22 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:22.993249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:23.004089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca5fc-2c41-49ff-9bac-a97bd12607c1 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:23.058401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bb4ca-6960-47d8-a831-a029291a7b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:23.059035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bb4ca-6960-47d8-a831-a029291a7b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:23.059305 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bb4ca-6960-47d8-a831-a029291a7b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:23.059585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bb4ca-6960-47d8-a831-a029291a7b93 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:23.060273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bb4ca-6960-47d8-a831-a029291a7b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:23.062251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bb4ca-6960-47d8-a831-a029291a7b93 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:23.204609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 963/1930] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:22 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:23.208195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dabd61-0266-4282-ac0c-178b9c05df41 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:23.218679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dabd61-0266-4282-ac0c-178b9c05df41 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:23.223909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d40570-d684-4c42-a747-568b12a14ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:23.224578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d40570-d684-4c42-a747-568b12a14ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:23.225021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d40570-d684-4c42-a747-568b12a14ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:23.225473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d40570-d684-4c42-a747-568b12a14ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:23.226241 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d40570-d684-4c42-a747-568b12a14ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:23.229594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d40570-d684-4c42-a747-568b12a14ea6 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:23.240487 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 968/1931] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:23.244915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bb4ca-6960-47d8-a831-a029291a7b93 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:23.256250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bb4ca-6960-47d8-a831-a029291a7b93 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:23.261148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdc3e7-885e-42b7-b290-95c4d6b76686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:23.261927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdc3e7-885e-42b7-b290-95c4d6b76686 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:23.262285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdc3e7-885e-42b7-b290-95c4d6b76686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:23.262543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdc3e7-885e-42b7-b290-95c4d6b76686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:23.263277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdc3e7-885e-42b7-b290-95c4d6b76686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:23.265025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdc3e7-885e-42b7-b290-95c4d6b76686 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:23.278670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 964/1932] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:23.283466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d40570-d684-4c42-a747-568b12a14ea6 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:23.294077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d40570-d684-4c42-a747-568b12a14ea6 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:23.299620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e8194-6df6-4e3f-b452-cab6037b68c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:23.309437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8194-6df6-4e3f-b452-cab6037b68c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:23.309437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8194-6df6-4e3f-b452-cab6037b68c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:23.309437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8194-6df6-4e3f-b452-cab6037b68c0 admin admin] PATH_INFO: `/v3/projects/fe1282c037f6400d9340e4a032c624ef/users/63958ccb48834413a46930dcfff4e754/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:23.317787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e8194-6df6-4e3f-b452-cab6037b68c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1282c037f6400d9340e4a032c624ef, user_id=63958ccb48834413a46930dcfff4e754, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:23.320864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e8194-6df6-4e3f-b452-cab6037b68c0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:23.399930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:23.449000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 969/1933] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:23 2022] PUT /identity/v3/projects/fe1282c037f6400d9340e4a032c624ef/users/63958ccb48834413a46930dcfff4e754/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:23.459907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5d82-f70d-4cec-bc31-734b23ea6870 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:23.460199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5d82-f70d-4cec-bc31-734b23ea6870 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:23.460686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5d82-f70d-4cec-bc31-734b23ea6870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:23.496695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7c8d5d82-f70d-4cec-bc31-734b23ea6870 None None] MFA Rules not processed for user `63958ccb48834413a46930dcfff4e754`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:23.498269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7c8d5d82-f70d-4cec-bc31-734b23ea6870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:23.576396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 965/1934] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:23.584899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e8194-6df6-4e3f-b452-cab6037b68c0 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:23.650234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e8194-6df6-4e3f-b452-cab6037b68c0 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:23.654695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae88eb-7665-4dff-93cd-eba9dea33b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:23.655423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae88eb-7665-4dff-93cd-eba9dea33b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:23.655757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae88eb-7665-4dff-93cd-eba9dea33b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:23.656045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae88eb-7665-4dff-93cd-eba9dea33b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:23.656771 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae88eb-7665-4dff-93cd-eba9dea33b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:23.659888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae88eb-7665-4dff-93cd-eba9dea33b4e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:23.815083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 970/1935] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:23 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:23.819001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d5d82-f70d-4cec-bc31-734b23ea6870 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:23.830207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d5d82-f70d-4cec-bc31-734b23ea6870 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:23.884954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642673c-30f6-43cb-b7d2-aea250ee9767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:23.885669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642673c-30f6-43cb-b7d2-aea250ee9767 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:23.885991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642673c-30f6-43cb-b7d2-aea250ee9767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:23.886278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642673c-30f6-43cb-b7d2-aea250ee9767 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:23.887144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642673c-30f6-43cb-b7d2-aea250ee9767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:23.888928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642673c-30f6-43cb-b7d2-aea250ee9767 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.013646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 966/1936] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:23 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:24.018717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae88eb-7665-4dff-93cd-eba9dea33b4e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:24.029549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae88eb-7665-4dff-93cd-eba9dea33b4e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:24.034547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9250fe-7a42-4f82-bb9e-c71911e51676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:24.035227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9250fe-7a42-4f82-bb9e-c71911e51676 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.035517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9250fe-7a42-4f82-bb9e-c71911e51676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.035798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9250fe-7a42-4f82-bb9e-c71911e51676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.036525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9250fe-7a42-4f82-bb9e-c71911e51676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:24.038230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9250fe-7a42-4f82-bb9e-c71911e51676 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.049192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 971/1937] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:24.054751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642673c-30f6-43cb-b7d2-aea250ee9767 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:24.065319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642673c-30f6-43cb-b7d2-aea250ee9767 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:24.070114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3112e8-0ad3-4826-943e-f998c988a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:24.070667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3112e8-0ad3-4826-943e-f998c988a079 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.071979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3112e8-0ad3-4826-943e-f998c988a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.072261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3112e8-0ad3-4826-943e-f998c988a079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.072991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3112e8-0ad3-4826-943e-f998c988a079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:24.074641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3112e8-0ad3-4826-943e-f998c988a079 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.085501 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 967/1938] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:24.089917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9250fe-7a42-4f82-bb9e-c71911e51676 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:24.101366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9250fe-7a42-4f82-bb9e-c71911e51676 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:24.110232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fe58f-6c76-4ad8-bdae-4658e613c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:24.110232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fe58f-6c76-4ad8-bdae-4658e613c309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.110232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fe58f-6c76-4ad8-bdae-4658e613c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.110232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fe58f-6c76-4ad8-bdae-4658e613c309 admin admin] PATH_INFO: `/v3/projects/5249c366c9d44450a2a4188092e2969e/users/fdb43df3b7d04d01a0dc7370cdd83619/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.123814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fe58f-6c76-4ad8-bdae-4658e613c309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5249c366c9d44450a2a4188092e2969e, user_id=fdb43df3b7d04d01a0dc7370cdd83619, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:24.127040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fe58f-6c76-4ad8-bdae-4658e613c309 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.224977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 972/1939] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:24 2022] PUT /identity/v3/projects/5249c366c9d44450a2a4188092e2969e/users/fdb43df3b7d04d01a0dc7370cdd83619/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:24.235746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2302-39bc-4c08-8df2-a6a21f765843 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.236913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2302-39bc-4c08-8df2-a6a21f765843 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.237454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2302-39bc-4c08-8df2-a6a21f765843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.267605 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-aa3c2302-39bc-4c08-8df2-a6a21f765843 None None] MFA Rules not processed for user `fdb43df3b7d04d01a0dc7370cdd83619`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:24.268936 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aa3c2302-39bc-4c08-8df2-a6a21f765843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:24.341844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 968/1940] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:24.346562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fe58f-6c76-4ad8-bdae-4658e613c309 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:24.414921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fe58f-6c76-4ad8-bdae-4658e613c309 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:24.418416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:24.421757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:24.424350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.424350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.424350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.424866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:24.427049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.556657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 973/1941] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:24 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:24.557764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2302-39bc-4c08-8df2-a6a21f765843 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:24.569465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2302-39bc-4c08-8df2-a6a21f765843 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:24.627941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecee39-74fd-4104-9c85-e4ceeb1a9221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:24.628632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecee39-74fd-4104-9c85-e4ceeb1a9221 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.628921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecee39-74fd-4104-9c85-e4ceeb1a9221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.629201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecee39-74fd-4104-9c85-e4ceeb1a9221 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.632818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecee39-74fd-4104-9c85-e4ceeb1a9221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:24.633870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecee39-74fd-4104-9c85-e4ceeb1a9221 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.661836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:24.663687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:24.676802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b511f-6a6b-40fd-a822-142f0452c63b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:24.685653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:24.685653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.685653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.685653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] PATH_INFO: `/v3/users/f263e26516094af598df2591f0829072` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.685939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f263e26516094af598df2591f0829072)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:24.686311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.716513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 969/1942] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:24 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:24.720956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecee39-74fd-4104-9c85-e4ceeb1a9221 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:24.730588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecee39-74fd-4104-9c85-e4ceeb1a9221 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:24.735167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dee48-cd96-4385-a56d-226def4ce5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:24.735846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dee48-cd96-4385-a56d-226def4ce5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.736129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dee48-cd96-4385-a56d-226def4ce5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.736403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dee48-cd96-4385-a56d-226def4ce5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.737151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dee48-cd96-4385-a56d-226def4ce5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:24.738803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dee48-cd96-4385-a56d-226def4ce5f9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.750363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 970/1943] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:24.767954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dee48-cd96-4385-a56d-226def4ce5f9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:24.777737 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dee48-cd96-4385-a56d-226def4ce5f9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:24.782456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060438a-8059-439a-8db1-2404e9569606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:24.783342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060438a-8059-439a-8db1-2404e9569606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:24.783884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060438a-8059-439a-8db1-2404e9569606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:24.784162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060438a-8059-439a-8db1-2404e9569606 admin admin] PATH_INFO: `/v3/projects/862c7e3f8d0f474a9ad7f0f5b799a0e1/users/1f72038851734ef5aa2466617d95c5e7/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:24.799619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060438a-8059-439a-8db1-2404e9569606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=862c7e3f8d0f474a9ad7f0f5b799a0e1, user_id=1f72038851734ef5aa2466617d95c5e7, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:24.802619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060438a-8059-439a-8db1-2404e9569606 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:24.940646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:24.948953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 971/1944] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:24 2022] PUT /identity/v3/projects/862c7e3f8d0f474a9ad7f0f5b799a0e1/users/1f72038851734ef5aa2466617d95c5e7/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:24.953646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060438a-8059-439a-8db1-2404e9569606 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:25.006747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f263e26516094af598df2591f0829072'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.014299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f263e26516094af598df2591f0829072'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.015439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f263e26516094af598df2591f0829072'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.015774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f263e26516094af598df2591f0829072'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.016010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060438a-8059-439a-8db1-2404e9569606 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:25.021631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:25.022365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.022652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.022931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.023800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:25.025379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:25.036396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 972/1945] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:25.040614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:25.042459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.055724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dd85e-db65-4ead-a5ad-3d4fe1845b6e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:25.060950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9f83-ac23-4486-b7e7-5e93fd4fd89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:25.061714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9f83-ac23-4486-b7e7-5e93fd4fd89b admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.062085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9f83-ac23-4486-b7e7-5e93fd4fd89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.062418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9f83-ac23-4486-b7e7-5e93fd4fd89b admin admin] PATH_INFO: `/v3/projects/862c7e3f8d0f474a9ad7f0f5b799a0e1/users/1f72038851734ef5aa2466617d95c5e7/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.065024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9f83-ac23-4486-b7e7-5e93fd4fd89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=862c7e3f8d0f474a9ad7f0f5b799a0e1, user_id=1f72038851734ef5aa2466617d95c5e7, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:25.067844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9f83-ac23-4486-b7e7-5e93fd4fd89b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:25.078504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 973/1946] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:25 2022] PUT /identity/v3/projects/862c7e3f8d0f474a9ad7f0f5b799a0e1/users/1f72038851734ef5aa2466617d95c5e7/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:25.089922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997b9d-bf1f-4285-8511-33a9209ec0fb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.090250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997b9d-bf1f-4285-8511-33a9209ec0fb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.090561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997b9d-bf1f-4285-8511-33a9209ec0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.104765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d2b78853-fdcc-446e-94d5-93fd0761d020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f263e26516094af598df2591f0829072'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:25.117464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f9997b9d-bf1f-4285-8511-33a9209ec0fb None None] MFA Rules not processed for user `1f72038851734ef5aa2466617d95c5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:25.119726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f9997b9d-bf1f-4285-8511-33a9209ec0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.124541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 974/1947] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:24 2022] DELETE /identity/v3/users/f263e26516094af598df2591f0829072 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:25.131516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7f28b-70c1-4486-92fa-131964a036e0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.132017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7f28b-70c1-4486-92fa-131964a036e0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.132507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7f28b-70c1-4486-92fa-131964a036e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.189205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b3f7f28b-70c1-4486-92fa-131964a036e0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:25.191853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b3f7f28b-70c1-4486-92fa-131964a036e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.315921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 974/1948] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:25.331069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997b9d-bf1f-4285-8511-33a9209ec0fb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:25.332484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f9997b9d-bf1f-4285-8511-33a9209ec0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.364785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 975/1949] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:25.377492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7f28b-70c1-4486-92fa-131964a036e0 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:25.379699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b3f7f28b-70c1-4486-92fa-131964a036e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.454694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7f28b-70c1-4486-92fa-131964a036e0 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:25.460472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:25.461486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.462336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.463302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.473095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:25.474933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:25.477950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997b9d-bf1f-4285-8511-33a9209ec0fb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:25.494316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 976/1950] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:25.548874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:25.549492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.549787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.550133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.616331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:25.617860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:25.627335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 975/1951] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:25.667793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:25.775576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:25.776964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.789943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0374a1d-fc86-41ca-9df6-9949b6cf3d60 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:25.793881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:25.794610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:25.794928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:25.795213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:25.797131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:25.859160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:25.860790 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:25.870068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 977/1952] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:26.057509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.058453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:26.075352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fddd96-7e74-4d63-9a25-fda6e92351a2 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.082022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.083316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.087207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.087207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] PATH_INFO: `/v3/projects/3cc2cf090aeb44e5b00a59c6a51388f0` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.087207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc2cf090aeb44e5b00a59c6a51388f0)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.089562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.202979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:26.222631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc2cf090aeb44e5b00a59c6a51388f0', 'request_id': 'req-138c6a22-cefe-4af8-8327-f38a3da5cbc7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.305833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc2cf090aeb44e5b00a59c6a51388f0', 'request_id': 'req-138c6a22-cefe-4af8-8327-f38a3da5cbc7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.313306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc2cf090aeb44e5b00a59c6a51388f0', 'request_id': 'req-138c6a22-cefe-4af8-8327-f38a3da5cbc7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.324095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] The token cache is being invalidate because project 3cc2cf090aeb44e5b00a59c6a51388f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:26.324611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.324791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.326398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 976/1953] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:26 2022] DELETE /identity/v3/projects/3cc2cf090aeb44e5b00a59c6a51388f0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:26.330473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:26.341865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea56a0-73be-44df-833f-149d9c8f38d6 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:26.400050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:26.400940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:26.401229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:26.401509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] PATH_INFO: `/v3/users/d06aaf8543e346d588523c1ecf611fc9` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:26.402728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06aaf8543e346d588523c1ecf611fc9)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:26.404678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:26.436668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:26.577925 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06aaf8543e346d588523c1ecf611fc9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.585721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06aaf8543e346d588523c1ecf611fc9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.586455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06aaf8543e346d588523c1ecf611fc9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.587115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06aaf8543e346d588523c1ecf611fc9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.642083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d0478646-f0ba-4755-ba21-9896e017b3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06aaf8543e346d588523c1ecf611fc9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:26.664550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 978/1954] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:26 2022] DELETE /identity/v3/users/d06aaf8543e346d588523c1ecf611fc9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:27.174316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.174316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:27.192968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c6a22-cefe-4af8-8327-f38a3da5cbc7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.256518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.257554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.257902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.258229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] PATH_INFO: `/v3/projects/5df8b0f5a580461d9107fee83ea4d895` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.260080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df8b0f5a580461d9107fee83ea4d895)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.261550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:27.263937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.401456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:27.432106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df8b0f5a580461d9107fee83ea4d895', 'request_id': 'req-b224b8b4-cf28-4213-a09d-156527bce81e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.558513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df8b0f5a580461d9107fee83ea4d895', 'request_id': 'req-b224b8b4-cf28-4213-a09d-156527bce81e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.573712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df8b0f5a580461d9107fee83ea4d895', 'request_id': 'req-b224b8b4-cf28-4213-a09d-156527bce81e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.586732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] The token cache is being invalidate because project 5df8b0f5a580461d9107fee83ea4d895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:27.587163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.587961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b224b8b4-cf28-4213-a09d-156527bce81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:27.589924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 977/1955] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:27 2022] DELETE /identity/v3/projects/5df8b0f5a580461d9107fee83ea4d895 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:27.594950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a5c4-a1c9-4b73-b247-1d049c3428d7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.596582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a5c4-a1c9-4b73-b247-1d049c3428d7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.596582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a5c4-a1c9-4b73-b247-1d049c3428d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.616054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ff84a5c4-a1c9-4b73-b247-1d049c3428d7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:27.619641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ff84a5c4-a1c9-4b73-b247-1d049c3428d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:27.708289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 979/1956] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:27.709953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e709-69cf-42a5-999b-4a3e0c535e95 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.710279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e709-69cf-42a5-999b-4a3e0c535e95 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.710559 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e709-69cf-42a5-999b-4a3e0c535e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.742992 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6701e709-69cf-42a5-999b-4a3e0c535e95 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:27.749508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6701e709-69cf-42a5-999b-4a3e0c535e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:27.752881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 978/1957] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:27.757144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a5c4-a1c9-4b73-b247-1d049c3428d7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.767676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a5c4-a1c9-4b73-b247-1d049c3428d7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.773035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.773791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.774122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.774391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.775237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:27.775475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.777282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.801753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 980/1958] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:27.805997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701e709-69cf-42a5-999b-4a3e0c535e95 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.819337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701e709-69cf-42a5-999b-4a3e0c535e95 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:27.824166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8204c4-991f-4814-9448-77388ed5427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:27.824833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8204c4-991f-4814-9448-77388ed5427a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:27.825123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8204c4-991f-4814-9448-77388ed5427a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:27.825531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8204c4-991f-4814-9448-77388ed5427a admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:27.826275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8204c4-991f-4814-9448-77388ed5427a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:27.828239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8204c4-991f-4814-9448-77388ed5427a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:27.971092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 979/1959] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:27.971787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:27.982536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821b310-592b-49d1-90bf-b9b0a4c4275c admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.076696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d126be5-1944-4489-8156-2e1034927165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.088674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d126be5-1944-4489-8156-2e1034927165 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.088674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d126be5-1944-4489-8156-2e1034927165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.088674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d126be5-1944-4489-8156-2e1034927165 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.088674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d126be5-1944-4489-8156-2e1034927165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.088674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d126be5-1944-4489-8156-2e1034927165 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.282952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:28.292712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 981/1960] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:27 2022] POST /identity/v3/users => generated 290 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:28.294002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8204c4-991f-4814-9448-77388ed5427a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.307363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8204c4-991f-4814-9448-77388ed5427a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.313486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8629b-32b3-4977-8d47-bc8336a78572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.314888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8629b-32b3-4977-8d47-bc8336a78572 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.315475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8629b-32b3-4977-8d47-bc8336a78572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.315575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8629b-32b3-4977-8d47-bc8336a78572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.316350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8629b-32b3-4977-8d47-bc8336a78572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.318217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8629b-32b3-4977-8d47-bc8336a78572 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.329773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 980/1961] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:28.333888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d126be5-1944-4489-8156-2e1034927165 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.344524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d126be5-1944-4489-8156-2e1034927165 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.349396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ba5c-d82f-48f1-8c51-df182a353649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.350111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ba5c-d82f-48f1-8c51-df182a353649 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.350403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ba5c-d82f-48f1-8c51-df182a353649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.350684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ba5c-d82f-48f1-8c51-df182a353649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.351554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ba5c-d82f-48f1-8c51-df182a353649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.353169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ba5c-d82f-48f1-8c51-df182a353649 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.365131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 982/1962] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:28.372469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8629b-32b3-4977-8d47-bc8336a78572 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.383253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8629b-32b3-4977-8d47-bc8336a78572 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.389780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7d7ec-7999-4d88-a0fe-dd1f657593ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.390721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d7ec-7999-4d88-a0fe-dd1f657593ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.391008 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d7ec-7999-4d88-a0fe-dd1f657593ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.391286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7d7ec-7999-4d88-a0fe-dd1f657593ad admin admin] PATH_INFO: `/v3/projects/7f506beea6c54766ab35f923e876adc5/users/bb4051fa56ab4cb6920b81a8dd23f819/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.410470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7d7ec-7999-4d88-a0fe-dd1f657593ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f506beea6c54766ab35f923e876adc5, user_id=bb4051fa56ab4cb6920b81a8dd23f819, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.413371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7d7ec-7999-4d88-a0fe-dd1f657593ad admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.505247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 981/1963] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:28 2022] PUT /identity/v3/projects/7f506beea6c54766ab35f923e876adc5/users/bb4051fa56ab4cb6920b81a8dd23f819/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:28.515442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8ff4e-74c1-4b4e-a95a-c0c0ff589304 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.515888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8ff4e-74c1-4b4e-a95a-c0c0ff589304 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.515997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8ff4e-74c1-4b4e-a95a-c0c0ff589304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.547289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d3b8ff4e-74c1-4b4e-a95a-c0c0ff589304 None None] MFA Rules not processed for user `bb4051fa56ab4cb6920b81a8dd23f819`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:28.549943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d3b8ff4e-74c1-4b4e-a95a-c0c0ff589304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:28.623539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 983/1964] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:28.625039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7d7ec-7999-4d88-a0fe-dd1f657593ad admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.735082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7d7ec-7999-4d88-a0fe-dd1f657593ad admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.744374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2152-e5b4-4347-83ce-a7d6cbc4a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.745122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2152-e5b4-4347-83ce-a7d6cbc4a995 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.745432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2152-e5b4-4347-83ce-a7d6cbc4a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.746166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2152-e5b4-4347-83ce-a7d6cbc4a995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.747013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db2152-e5b4-4347-83ce-a7d6cbc4a995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.749379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db2152-e5b4-4347-83ce-a7d6cbc4a995 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:28.844793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 982/1965] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:28 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:28.849089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8ff4e-74c1-4b4e-a95a-c0c0ff589304 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:28.860887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8ff4e-74c1-4b4e-a95a-c0c0ff589304 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:28.872853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:28.927199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d465f-8a40-4276-b5d3-7e83779c02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:28.927954 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d465f-8a40-4276-b5d3-7e83779c02f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:28.928245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d465f-8a40-4276-b5d3-7e83779c02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:28.928529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d465f-8a40-4276-b5d3-7e83779c02f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:28.929243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d465f-8a40-4276-b5d3-7e83779c02f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:28.931348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d465f-8a40-4276-b5d3-7e83779c02f7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:29.048231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 984/1966] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:28 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:29.052228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2152-e5b4-4347-83ce-a7d6cbc4a995 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:29.062535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2152-e5b4-4347-83ce-a7d6cbc4a995 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:29.067379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f49db-f6a4-432a-9c51-6cd18b5803cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:29.068079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f49db-f6a4-432a-9c51-6cd18b5803cd admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:29.068362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f49db-f6a4-432a-9c51-6cd18b5803cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:29.068645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f49db-f6a4-432a-9c51-6cd18b5803cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:29.069470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f49db-f6a4-432a-9c51-6cd18b5803cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:29.071119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f49db-f6a4-432a-9c51-6cd18b5803cd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:29.082613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 983/1967] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:29.086878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d465f-8a40-4276-b5d3-7e83779c02f7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:29.097874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d465f-8a40-4276-b5d3-7e83779c02f7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:29.102707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c3315-2014-44fd-a260-02069288f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:29.103725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3315-2014-44fd-a260-02069288f91e admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:29.104092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3315-2014-44fd-a260-02069288f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:29.104379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3315-2014-44fd-a260-02069288f91e admin admin] PATH_INFO: `/v3/projects/f83c7ea8c11f4c5b88a3bf817277f28b/users/10524dd604e04495bc24fc994863ff39/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:29.126337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c3315-2014-44fd-a260-02069288f91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83c7ea8c11f4c5b88a3bf817277f28b, user_id=10524dd604e04495bc24fc994863ff39, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:29.129096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c3315-2014-44fd-a260-02069288f91e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:29.173861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:29.248238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 985/1968] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:29 2022] PUT /identity/v3/projects/f83c7ea8c11f4c5b88a3bf817277f28b/users/10524dd604e04495bc24fc994863ff39/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:29.252921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f49db-f6a4-432a-9c51-6cd18b5803cd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:29.280634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f49db-f6a4-432a-9c51-6cd18b5803cd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:29.354988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c39d8-6983-441f-9380-5e168928c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:29.355675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c39d8-6983-441f-9380-5e168928c1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:29.355960 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c39d8-6983-441f-9380-5e168928c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:29.356237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c39d8-6983-441f-9380-5e168928c1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:29.356979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c39d8-6983-441f-9380-5e168928c1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:29.358957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c39d8-6983-441f-9380-5e168928c1e6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:29.370002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 984/1969] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:29.373982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c3315-2014-44fd-a260-02069288f91e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:29.385574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c3315-2014-44fd-a260-02069288f91e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:29.390844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:29.393022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:29.393022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:29.393022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] PATH_INFO: `/v3/projects/f83c7ea8c11f4c5b88a3bf817277f28b/users/10524dd604e04495bc24fc994863ff39/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:29.396371 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83c7ea8c11f4c5b88a3bf817277f28b, user_id=10524dd604e04495bc24fc994863ff39, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:29.397885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:29.414654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 986/1970] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:29 2022] PUT /identity/v3/projects/f83c7ea8c11f4c5b88a3bf817277f28b/users/10524dd604e04495bc24fc994863ff39/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:29.421651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6ac2-b0b1-4b48-984d-b2ec5fe32aa0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:29.421949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6ac2-b0b1-4b48-984d-b2ec5fe32aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:29.422261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6ac2-b0b1-4b48-984d-b2ec5fe32aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:29.451896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f79c6ac2-b0b1-4b48-984d-b2ec5fe32aa0 None None] MFA Rules not processed for user `10524dd604e04495bc24fc994863ff39`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:29.453127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f79c6ac2-b0b1-4b48-984d-b2ec5fe32aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:29.573363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 985/1971] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:29.577680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:29.580360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:29.604129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6ac2-b0b1-4b48-984d-b2ec5fe32aa0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:29.605583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f79c6ac2-b0b1-4b48-984d-b2ec5fe32aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:29.666512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ea31-162a-448e-932a-92e20f8e2e67 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:29.672355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:29.674601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:29.674905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:29.675189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] PATH_INFO: `/v3/users/55969fee95424c41a04ccfc954363979` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:29.676822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55969fee95424c41a04ccfc954363979)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:29.678158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6ac2-b0b1-4b48-984d-b2ec5fe32aa0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:29.678959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:29.686565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb9ed1-46b1-459f-b123-9c84901be9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:29.687280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9ed1-46b1-459f-b123-9c84901be9fb service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:29.687579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9ed1-46b1-459f-b123-9c84901be9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:29.687900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9ed1-46b1-459f-b123-9c84901be9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:29.701351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb9ed1-46b1-459f-b123-9c84901be9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:29.703250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb9ed1-46b1-459f-b123-9c84901be9fb service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:29.719224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 986/1972] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:30.021657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55969fee95424c41a04ccfc954363979'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:30.027544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55969fee95424c41a04ccfc954363979'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:30.028653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55969fee95424c41a04ccfc954363979'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:30.029194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55969fee95424c41a04ccfc954363979'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:30.099821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:30.133395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55969fee95424c41a04ccfc954363979'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:30.151171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 987/1973] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:29 2022] DELETE /identity/v3/users/55969fee95424c41a04ccfc954363979 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:30.155631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc267a6-da63-42d4-a0b7-5d68e17986e0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:30.155931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc267a6-da63-42d4-a0b7-5d68e17986e0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:30.156221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc267a6-da63-42d4-a0b7-5d68e17986e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:30.174516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:30.175129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9dc267a6-da63-42d4-a0b7-5d68e17986e0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:30.176385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9dc267a6-da63-42d4-a0b7-5d68e17986e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:30.235765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 987/1974] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:30.245688 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:30.247271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:30.314836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393398-f0a4-440a-a830-dcb11be49e61 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:30.314836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc5eb6-b347-411b-915d-993c621c10d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:30.314836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc5eb6-b347-411b-915d-993c621c10d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:30.314836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc5eb6-b347-411b-915d-993c621c10d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:30.315219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc5eb6-b347-411b-915d-993c621c10d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:30.319493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc5eb6-b347-411b-915d-993c621c10d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:30.321085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc5eb6-b347-411b-915d-993c621c10d8 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:30.331340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 988/1975] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:30.840493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc267a6-da63-42d4-a0b7-5d68e17986e0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:30.840493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9dc267a6-da63-42d4-a0b7-5d68e17986e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:30.853101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc267a6-da63-42d4-a0b7-5d68e17986e0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:30.858139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:30.859014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:30.859304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:30.859584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] PATH_INFO: `/v3/projects/963eee45a9944ae58adc9208d2a4d958` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:30.860775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=963eee45a9944ae58adc9208d2a4d958)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:30.863490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:31.002487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963eee45a9944ae58adc9208d2a4d958', 'request_id': 'req-e1061ac4-74e3-414b-92fb-fe1d3a999875'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.119710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963eee45a9944ae58adc9208d2a4d958', 'request_id': 'req-e1061ac4-74e3-414b-92fb-fe1d3a999875'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.122840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963eee45a9944ae58adc9208d2a4d958', 'request_id': 'req-e1061ac4-74e3-414b-92fb-fe1d3a999875'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.134301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] The token cache is being invalidate because project 963eee45a9944ae58adc9208d2a4d958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:31.134597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.135260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.136823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 988/1976] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:30 2022] DELETE /identity/v3/projects/963eee45a9944ae58adc9208d2a4d958 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:31.140948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc5eb6-b347-411b-915d-993c621c10d8 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:31.150799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc5eb6-b347-411b-915d-993c621c10d8 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:31.182241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:31.183658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:31.209073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:31.209988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:31.210274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:31.210556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] PATH_INFO: `/v3/users/e8fa5b0ca538445da578a9e8f0295f36` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:31.211756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fa5b0ca538445da578a9e8f0295f36)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:31.213708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:31.248840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061ac4-74e3-414b-92fb-fe1d3a999875 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:31.254030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10524dd604e04495bc24fc994863ff39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83c7ea8c11f4c5b88a3bf817277f28b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:31.254697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:31.254984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:31.255264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:31.255985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:31.256289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:31.257941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:31.269185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 989/1977] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:16:31.273230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:31.282570 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421d66c-3c1c-47e1-9872-8f291a4b8015 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:31.287459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f61b-5dd7-41dd-9ff3-ca84e25bf731 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10524dd604e04495bc24fc994863ff39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83c7ea8c11f4c5b88a3bf817277f28b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:31.288056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f61b-5dd7-41dd-9ff3-ca84e25bf731 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:31.288344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f61b-5dd7-41dd-9ff3-ca84e25bf731 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:31.288624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f61b-5dd7-41dd-9ff3-ca84e25bf731 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:31.289335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54f61b-5dd7-41dd-9ff3-ca84e25bf731 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:31.291218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54f61b-5dd7-41dd-9ff3-ca84e25bf731 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:31.492127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 990/1978] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:31 2022] POST /identity/v3/projects => generated 354 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:31.493238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f61b-5dd7-41dd-9ff3-ca84e25bf731 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:31.530111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fa5b0ca538445da578a9e8f0295f36'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.538532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fa5b0ca538445da578a9e8f0295f36'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.539276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fa5b0ca538445da578a9e8f0295f36'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.539901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fa5b0ca538445da578a9e8f0295f36'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.548147 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:31.560442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f61b-5dd7-41dd-9ff3-ca84e25bf731 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:31.568156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10524dd604e04495bc24fc994863ff39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83c7ea8c11f4c5b88a3bf817277f28b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:31.568875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:31.569169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:31.569456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:31.570233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:31.570576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:31.572201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:31.585207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 991/1979] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:16:31.585207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:31.590001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:31.651249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0316c-7889-42a6-93f5-d09b19d01874 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:31.655689 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:31.656553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:31.656835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:31.657108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] PATH_INFO: `/v3/users/63958ccb48834413a46930dcfff4e754` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:31.659143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63958ccb48834413a46930dcfff4e754)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:31.661101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:31.670098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fa5b0ca538445da578a9e8f0295f36'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.690052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 989/1980] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:31 2022] DELETE /identity/v3/users/e8fa5b0ca538445da578a9e8f0295f36 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:31.690899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:31.692286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:31.760461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd53af-59dd-4776-9fda-e44674700fce admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:31.765081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10524dd604e04495bc24fc994863ff39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83c7ea8c11f4c5b88a3bf817277f28b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:31.766234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:31.766345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:31.766600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] PATH_INFO: `/v3/projects/ba7fee0924c24dab88f24ffc8615840d` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:31.767901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba7fee0924c24dab88f24ffc8615840d)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:31.770499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:31.901478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63958ccb48834413a46930dcfff4e754'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.909233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63958ccb48834413a46930dcfff4e754'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.944260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7fee0924c24dab88f24ffc8615840d', 'request_id': 'req-3684e534-2d99-4357-81ff-665cfe6a4cc8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.950696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7fee0924c24dab88f24ffc8615840d', 'request_id': 'req-3684e534-2d99-4357-81ff-665cfe6a4cc8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.996406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63958ccb48834413a46930dcfff4e754'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.997033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63958ccb48834413a46930dcfff4e754'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:31.997648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b9811daf-029e-4017-b147-e384a8240596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63958ccb48834413a46930dcfff4e754'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.018516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 992/1981] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:31 2022] DELETE /identity/v3/users/63958ccb48834413a46930dcfff4e754 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:32.023160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e999-843d-4dc4-bf9e-3378f9ac65fb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:32.023519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e999-843d-4dc4-bf9e-3378f9ac65fb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:32.023750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e999-843d-4dc4-bf9e-3378f9ac65fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:32.027308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:32.046017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-88e0e999-843d-4dc4-bf9e-3378f9ac65fb None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:32.047346 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-88e0e999-843d-4dc4-bf9e-3378f9ac65fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:32.105523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7fee0924c24dab88f24ffc8615840d', 'request_id': 'req-3684e534-2d99-4357-81ff-665cfe6a4cc8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.113299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 993/1982] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:32.120019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0e999-843d-4dc4-bf9e-3378f9ac65fb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:32.121541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-88e0e999-843d-4dc4-bf9e-3378f9ac65fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:32.122265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] The token cache is being invalidate because project ba7fee0924c24dab88f24ffc8615840d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:32.122569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.123250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.125108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 990/1983] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:31 2022] DELETE /identity/v3/projects/ba7fee0924c24dab88f24ffc8615840d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:32.190298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0e999-843d-4dc4-bf9e-3378f9ac65fb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:32.193926 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:32.194605 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:32.195087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:32.195202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:32.197071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:32.210972 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:32.212721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:32.223975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 994/1984] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:32.392843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:32.395007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:32.476715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684e534-2d99-4357-81ff-665cfe6a4cc8 tempest-VolumeQuotaClassesTest-333541685 tempest-VolumeQuotaClassesTest-333541685-project-admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:32.481282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:32.482189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:32.482479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:32.482758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] PATH_INFO: `/v3/projects/260ab45f7ae548e290183948ff3b1da2` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:32.483992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] RBAC: Authorizing `identity:delete_project(project_id=260ab45f7ae548e290183948ff3b1da2)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:32.485978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:32.652579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260ab45f7ae548e290183948ff3b1da2', 'request_id': 'req-130687f2-e13d-4976-924a-0f52db87416e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.659076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260ab45f7ae548e290183948ff3b1da2', 'request_id': 'req-130687f2-e13d-4976-924a-0f52db87416e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.754307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260ab45f7ae548e290183948ff3b1da2', 'request_id': 'req-130687f2-e13d-4976-924a-0f52db87416e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.770867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] The token cache is being invalidate because project 260ab45f7ae548e290183948ff3b1da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:32.771448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.778028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:32.780978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 991/1985] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:32 2022] DELETE /identity/v3/projects/260ab45f7ae548e290183948ff3b1da2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:32.785827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:32.797102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a375-5d5b-4d83-9abe-b5fd192488d6 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:32.867247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:32.868795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:32.869083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:32.870255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] PATH_INFO: `/v3/users/d1956b35834342a39579b65d24b7881e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:32.872247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1956b35834342a39579b65d24b7881e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:32.875700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:33.067053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:33.068678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:33.081766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1956b35834342a39579b65d24b7881e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.084758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130687f2-e13d-4976-924a-0f52db87416e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:33.090546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:33.091621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1956b35834342a39579b65d24b7881e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.092404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:33.092901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:33.093439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] PATH_INFO: `/v3/users/bb4051fa56ab4cb6920b81a8dd23f819` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:33.095038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4051fa56ab4cb6920b81a8dd23f819)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:33.098668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:33.201592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1956b35834342a39579b65d24b7881e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.202477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1956b35834342a39579b65d24b7881e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.203130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-acbdc16a-d36d-4142-b504-06a25237489e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1956b35834342a39579b65d24b7881e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.226204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 995/1986] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:32 2022] DELETE /identity/v3/users/d1956b35834342a39579b65d24b7881e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:33.355863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4051fa56ab4cb6920b81a8dd23f819'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.364971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:33.369188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4051fa56ab4cb6920b81a8dd23f819'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.370216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4051fa56ab4cb6920b81a8dd23f819'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.374002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4051fa56ab4cb6920b81a8dd23f819'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.486233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4051fa56ab4cb6920b81a8dd23f819'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:33.517497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 992/1987] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:33 2022] DELETE /identity/v3/users/bb4051fa56ab4cb6920b81a8dd23f819 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:33.521692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46494a-29aa-490a-b9d3-8ed9e49a272f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:33.522201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46494a-29aa-490a-b9d3-8ed9e49a272f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:33.522635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46494a-29aa-490a-b9d3-8ed9e49a272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:33.557592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1a46494a-29aa-490a-b9d3-8ed9e49a272f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:33.559199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1a46494a-29aa-490a-b9d3-8ed9e49a272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:33.631244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 996/1988] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:33.659027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:33.661079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:33.705546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46494a-29aa-490a-b9d3-8ed9e49a272f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:33.708812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1a46494a-29aa-490a-b9d3-8ed9e49a272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:33.725378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46494a-29aa-490a-b9d3-8ed9e49a272f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:33.734070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:33.735190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:33.735485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:33.736849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] PATH_INFO: `/v3/projects/fe1282c037f6400d9340e4a032c624ef` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:33.738997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1282c037f6400d9340e4a032c624ef)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:33.739081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f2e1b-ab11-4548-8c97-11efe1ad3641 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:33.742716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:33.749633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c8b3-df14-44e1-9e12-695a64e9bca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:33.750606 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c8b3-df14-44e1-9e12-695a64e9bca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:33.751044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c8b3-df14-44e1-9e12-695a64e9bca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:33.751522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c8b3-df14-44e1-9e12-695a64e9bca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:33.765279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c8b3-df14-44e1-9e12-695a64e9bca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:33.767186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3c8b3-df14-44e1-9e12-695a64e9bca9 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:33.779235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 993/1989] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:33.936715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1282c037f6400d9340e4a032c624ef', 'request_id': 'req-af56d25b-217f-4534-9b72-abdcfb61ee38'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.020248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:34.054500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1282c037f6400d9340e4a032c624ef', 'request_id': 'req-af56d25b-217f-4534-9b72-abdcfb61ee38'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.064391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1282c037f6400d9340e4a032c624ef', 'request_id': 'req-af56d25b-217f-4534-9b72-abdcfb61ee38'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.075757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] The token cache is being invalidate because project fe1282c037f6400d9340e4a032c624ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:34.076958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.077798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.080324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 997/1990] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:33 2022] DELETE /identity/v3/projects/fe1282c037f6400d9340e4a032c624ef => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:34.084301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c8b3-df14-44e1-9e12-695a64e9bca9 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:34.094782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c8b3-df14-44e1-9e12-695a64e9bca9 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:34.170327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:34.171318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:34.172113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:34.172522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] PATH_INFO: `/v3/users/fdb43df3b7d04d01a0dc7370cdd83619` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:34.174614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb43df3b7d04d01a0dc7370cdd83619)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:34.176845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:34.227331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:34.228945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:34.243229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56d25b-217f-4534-9b72-abdcfb61ee38 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:34.248307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:34.249205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:34.249625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:34.249914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] PATH_INFO: `/v3/projects/b253f07072924683a9d4985d4ca7e8f2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:34.251168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b253f07072924683a9d4985d4ca7e8f2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:34.253153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:34.406917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b253f07072924683a9d4985d4ca7e8f2', 'request_id': 'req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.590866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b253f07072924683a9d4985d4ca7e8f2', 'request_id': 'req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.598628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b253f07072924683a9d4985d4ca7e8f2', 'request_id': 'req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.609803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb43df3b7d04d01a0dc7370cdd83619'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.610725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] The token cache is being invalidate because project b253f07072924683a9d4985d4ca7e8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:34.611802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.612774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.615126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 998/1991] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:34 2022] DELETE /identity/v3/projects/b253f07072924683a9d4985d4ca7e8f2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:34.616104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:34.618528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb43df3b7d04d01a0dc7370cdd83619'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.619625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb43df3b7d04d01a0dc7370cdd83619'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.620252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb43df3b7d04d01a0dc7370cdd83619'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.623224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:34.704483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4d928dca-e91a-4f66-b581-01816aef5018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb43df3b7d04d01a0dc7370cdd83619'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.705003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd155d5-8c7f-4834-b06e-f56b69d2f7cb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:34.711841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:34.713302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:34.713667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:34.714047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] PATH_INFO: `/v3/projects/7f506beea6c54766ab35f923e876adc5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:34.715572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f506beea6c54766ab35f923e876adc5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:34.717782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:34.770453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 994/1992] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:34 2022] DELETE /identity/v3/users/fdb43df3b7d04d01a0dc7370cdd83619 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:34.773342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c03cd-2889-40b8-a4a9-59eab48dd3ad None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:34.773342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c03cd-2889-40b8-a4a9-59eab48dd3ad None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:34.773342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c03cd-2889-40b8-a4a9-59eab48dd3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:34.810669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-8a4c03cd-2889-40b8-a4a9-59eab48dd3ad None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:34.811834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8a4c03cd-2889-40b8-a4a9-59eab48dd3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:34.912074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 995/1993] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:34.920978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b5d4e-1115-486b-b9bc-c5ac7e329778 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:34.927409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b5d4e-1115-486b-b9bc-c5ac7e329778 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:34.928748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b5d4e-1115-486b-b9bc-c5ac7e329778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:34.930019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f506beea6c54766ab35f923e876adc5', 'request_id': 'req-2411d75a-4d7c-4dac-b2ad-351e951c894f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:34.962523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:34.967531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b29b5d4e-1115-486b-b9bc-c5ac7e329778 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:34.969159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b29b5d4e-1115-486b-b9bc-c5ac7e329778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:35.054234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f506beea6c54766ab35f923e876adc5', 'request_id': 'req-2411d75a-4d7c-4dac-b2ad-351e951c894f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.063549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f506beea6c54766ab35f923e876adc5', 'request_id': 'req-2411d75a-4d7c-4dac-b2ad-351e951c894f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.064159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 996/1994] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:35.068463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b5d4e-1115-486b-b9bc-c5ac7e329778 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:35.082446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] The token cache is being invalidate because project 7f506beea6c54766ab35f923e876adc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:35.082739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.083421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.083978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b5d4e-1115-486b-b9bc-c5ac7e329778 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:35.084990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 999/1995] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:34 2022] DELETE /identity/v3/projects/7f506beea6c54766ab35f923e876adc5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:35.088865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:35.090658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:35.090937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:35.091950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:35.092336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:35.092680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:35.093482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:35.093856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:35.096674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:35.112656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d75a-4d7c-4dac-b2ad-351e951c894f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:35.122234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 997/1996] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:16:35.123871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:35.127477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:35.127905 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:35.129092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:35.129478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:35.129868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] PATH_INFO: `/v3/users/10524dd604e04495bc24fc994863ff39` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:35.131957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=10524dd604e04495bc24fc994863ff39)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:35.134214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:35.146645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ab24a-e93d-4b4a-a930-1983ca982b30 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:35.152132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2d83-dab6-4033-adec-4aad59cf2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:35.166057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2d83-dab6-4033-adec-4aad59cf2df1 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:35.166057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2d83-dab6-4033-adec-4aad59cf2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:35.166057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2d83-dab6-4033-adec-4aad59cf2df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:35.166057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce2d83-dab6-4033-adec-4aad59cf2df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:35.166057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce2d83-dab6-4033-adec-4aad59cf2df1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:35.238452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:35.332740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 998/1997] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:35 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:35.332740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2d83-dab6-4033-adec-4aad59cf2df1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:35.398530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2d83-dab6-4033-adec-4aad59cf2df1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:35.403248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:35.403918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:35.404207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:35.404518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:35.405207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:35.407276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:35.518996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10524dd604e04495bc24fc994863ff39'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.527066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10524dd604e04495bc24fc994863ff39'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.596066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 999/1998] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:35 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:35.596906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:35.600404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:35.610316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715187af-5f79-4bf9-9bb5-0903071b6efc admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:35.615473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:35.616322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:35.616661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:35.616933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] PATH_INFO: `/v3/projects/5249c366c9d44450a2a4188092e2969e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:35.618130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5249c366c9d44450a2a4188092e2969e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:35.620040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:35.670203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10524dd604e04495bc24fc994863ff39'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.670825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10524dd604e04495bc24fc994863ff39'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.671430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10524dd604e04495bc24fc994863ff39'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.691750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1000/1999] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:35 2022] DELETE /identity/v3/users/10524dd604e04495bc24fc994863ff39 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:35.691750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:35.692998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:35.760719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190579e2-7f8c-466a-b6a7-f501bf27ca1c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:35.765386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aa7cf-c9c0-4783-8097-88b3babdbb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:35.766149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aa7cf-c9c0-4783-8097-88b3babdbb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:35.766440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aa7cf-c9c0-4783-8097-88b3babdbb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:35.766743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aa7cf-c9c0-4783-8097-88b3babdbb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:35.767540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2aa7cf-c9c0-4783-8097-88b3babdbb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:35.769217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2aa7cf-c9c0-4783-8097-88b3babdbb95 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:35.780593 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1001/2000] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:35.785031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aa7cf-c9c0-4783-8097-88b3babdbb95 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:35.795203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aa7cf-c9c0-4783-8097-88b3babdbb95 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:35.800119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5249c366c9d44450a2a4188092e2969e', 'request_id': 'req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.806884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5249c366c9d44450a2a4188092e2969e', 'request_id': 'req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.849954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e7061-7b94-4470-92d4-d2901589d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:35.850583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e7061-7b94-4470-92d4-d2901589d2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:35.850866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e7061-7b94-4470-92d4-d2901589d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:35.851142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e7061-7b94-4470-92d4-d2901589d2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:35.851883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e7061-7b94-4470-92d4-d2901589d2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:35.853494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e7061-7b94-4470-92d4-d2901589d2bf admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:35.865090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1002/2001] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:35.868986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e7061-7b94-4470-92d4-d2901589d2bf admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:35.879025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e7061-7b94-4470-92d4-d2901589d2bf admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:35.883640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721deaa-0d64-48f8-a49a-9555421f77af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:35.884508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721deaa-0d64-48f8-a49a-9555421f77af admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:35.884792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721deaa-0d64-48f8-a49a-9555421f77af admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:35.885093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721deaa-0d64-48f8-a49a-9555421f77af admin admin] PATH_INFO: `/v3/projects/0a787665cd204975b3c75feec1d9f2b7/users/0189d55985cd4f3a8e09079254039209/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:35.900004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721deaa-0d64-48f8-a49a-9555421f77af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a787665cd204975b3c75feec1d9f2b7, user_id=0189d55985cd4f3a8e09079254039209, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:35.902724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721deaa-0d64-48f8-a49a-9555421f77af admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:35.984312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5249c366c9d44450a2a4188092e2969e', 'request_id': 'req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.996303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] The token cache is being invalidate because project 5249c366c9d44450a2a4188092e2969e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:35.996600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:35.997263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.002188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1000/2002] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:35 2022] DELETE /identity/v3/projects/5249c366c9d44450a2a4188092e2969e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:36.003044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:36.004379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:36.017172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677d554-5ee7-4126-a1fd-0bd3b96cc3b5 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:36.022569 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1003/2003] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:35 2022] PUT /identity/v3/projects/0a787665cd204975b3c75feec1d9f2b7/users/0189d55985cd4f3a8e09079254039209/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:36.033839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76f43-ca61-404c-bc29-9ffb487e47e4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:36.034104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76f43-ca61-404c-bc29-9ffb487e47e4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:36.034385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af76f43-ca61-404c-bc29-9ffb487e47e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:36.064978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8af76f43-ca61-404c-bc29-9ffb487e47e4 None None] MFA Rules not processed for user `0189d55985cd4f3a8e09079254039209`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:36.066235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8af76f43-ca61-404c-bc29-9ffb487e47e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:36.105554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:36.105554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:36.105554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:36.105554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] PATH_INFO: `/v3/users/1f72038851734ef5aa2466617d95c5e7` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:36.115201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f72038851734ef5aa2466617d95c5e7)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:36.117173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:36.141762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1004/2004] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:36.153345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af76f43-ca61-404c-bc29-9ffb487e47e4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:36.154980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8af76f43-ca61-404c-bc29-9ffb487e47e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:36.220525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af76f43-ca61-404c-bc29-9ffb487e47e4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:36.229281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca08d82f02a24e0088aceff2b6ba307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:36.230462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:36.230705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:36.230987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:36.241368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:36.244223 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:36.257340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1005/2005] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:36.258261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:36.259558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:36.277783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8058b5-00b7-4d8b-9365-6f55bc2edbcb service glance] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:36.293587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:36.294725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:36.295014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:36.295299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] PATH_INFO: `/v3/projects/f83c7ea8c11f4c5b88a3bf817277f28b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:36.296545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83c7ea8c11f4c5b88a3bf817277f28b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:36.299310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:36.564795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83c7ea8c11f4c5b88a3bf817277f28b', 'request_id': 'req-49149f73-ec1d-437e-bfd4-6a9edab9645c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.569222 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f72038851734ef5aa2466617d95c5e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.576337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f72038851734ef5aa2466617d95c5e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.577008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f72038851734ef5aa2466617d95c5e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.577649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f72038851734ef5aa2466617d95c5e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.704883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83c7ea8c11f4c5b88a3bf817277f28b', 'request_id': 'req-49149f73-ec1d-437e-bfd4-6a9edab9645c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.711799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83c7ea8c11f4c5b88a3bf817277f28b', 'request_id': 'req-49149f73-ec1d-437e-bfd4-6a9edab9645c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.722614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] The token cache is being invalidate because project f83c7ea8c11f4c5b88a3bf817277f28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:36.722900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.723534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-49149f73-ec1d-437e-bfd4-6a9edab9645c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.725060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1006/2006] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:36 2022] DELETE /identity/v3/projects/f83c7ea8c11f4c5b88a3bf817277f28b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:36.730113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0041e5-dbf5-4e7a-9387-8e93700b7daa None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:36.730416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0041e5-dbf5-4e7a-9387-8e93700b7daa None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:36.730715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0041e5-dbf5-4e7a-9387-8e93700b7daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:36.750808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1e0041e5-dbf5-4e7a-9387-8e93700b7daa None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:36.752828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1e0041e5-dbf5-4e7a-9387-8e93700b7daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:36.814511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1007/2007] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:36.822997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1af3a-74cf-489a-901d-1d55d2fbac79 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:36.823338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1af3a-74cf-489a-901d-1d55d2fbac79 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:36.823665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1af3a-74cf-489a-901d-1d55d2fbac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:36.830642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f72038851734ef5aa2466617d95c5e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:36.841913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d3f1af3a-74cf-489a-901d-1d55d2fbac79 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:36.843200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d3f1af3a-74cf-489a-901d-1d55d2fbac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:36.848278 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1001/2008] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:36 2022] DELETE /identity/v3/users/1f72038851734ef5aa2466617d95c5e7 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:36.851263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1008/2009] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:36.859845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:36.861348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:36.928332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71214fb-ccb0-473f-bb42-6a6a997dbd85 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:36.933232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:36.933916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:36.934240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:36.934521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:36.935257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:36.935568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:36.937259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:36.949729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1002/2010] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:36.954101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1af3a-74cf-489a-901d-1d55d2fbac79 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:36.963987 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1af3a-74cf-489a-901d-1d55d2fbac79 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:36.968654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:36.969300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:36.969580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:36.969879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:36.970655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:36.972616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.096005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1009/2011] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:36 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:37.100015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:37.112884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afadb8b-aa76-417a-ba9d-8fbcac78e0a7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:37.171167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edec5e-fde5-4675-aeb9-fb90374de572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:37.171946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edec5e-fde5-4675-aeb9-fb90374de572 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.172268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edec5e-fde5-4675-aeb9-fb90374de572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.172551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edec5e-fde5-4675-aeb9-fb90374de572 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.173816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edec5e-fde5-4675-aeb9-fb90374de572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:37.175799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edec5e-fde5-4675-aeb9-fb90374de572 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.391156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:37.391731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1003/2012] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:37 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:37.393693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:37.395542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edec5e-fde5-4675-aeb9-fb90374de572 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:37.410001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edec5e-fde5-4675-aeb9-fb90374de572 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:37.421058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ef8c-2e12-4f82-b9f9-9fb240c47af8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:37.421256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fff41-595f-45f1-96b4-2680f7ec5744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:37.421256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fff41-595f-45f1-96b4-2680f7ec5744 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.421256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fff41-595f-45f1-96b4-2680f7ec5744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.421256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fff41-595f-45f1-96b4-2680f7ec5744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.421585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fff41-595f-45f1-96b4-2680f7ec5744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:37.424131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fff41-595f-45f1-96b4-2680f7ec5744 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.428077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:37.429154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.429587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.430061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] PATH_INFO: `/v3/projects/862c7e3f8d0f474a9ad7f0f5b799a0e1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.431698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=862c7e3f8d0f474a9ad7f0f5b799a0e1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:37.433787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.443252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1004/2013] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:37.447432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fff41-595f-45f1-96b4-2680f7ec5744 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:37.462303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fff41-595f-45f1-96b4-2680f7ec5744 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:37.467993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb80844-4f3b-42aa-bf67-a8dbfbc47746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:37.468823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80844-4f3b-42aa-bf67-a8dbfbc47746 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.469116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80844-4f3b-42aa-bf67-a8dbfbc47746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.469462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80844-4f3b-42aa-bf67-a8dbfbc47746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.470878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb80844-4f3b-42aa-bf67-a8dbfbc47746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:37.472905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb80844-4f3b-42aa-bf67-a8dbfbc47746 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.486661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1005/2014] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:37.490485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb80844-4f3b-42aa-bf67-a8dbfbc47746 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:37.500441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb80844-4f3b-42aa-bf67-a8dbfbc47746 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:37.512523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078622ba-80dd-447f-ad41-51df82760177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:37.512523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078622ba-80dd-447f-ad41-51df82760177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.512523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078622ba-80dd-447f-ad41-51df82760177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.512523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078622ba-80dd-447f-ad41-51df82760177 admin admin] PATH_INFO: `/v3/projects/b84824c4e4884094805200d809cebb39/users/c422cd9b325845e48ae64383b234c04b/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.521378 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078622ba-80dd-447f-ad41-51df82760177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84824c4e4884094805200d809cebb39, user_id=c422cd9b325845e48ae64383b234c04b, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:37.524307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078622ba-80dd-447f-ad41-51df82760177 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.653776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1006/2015] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:37 2022] PUT /identity/v3/projects/b84824c4e4884094805200d809cebb39/users/c422cd9b325845e48ae64383b234c04b/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:37.661875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862c7e3f8d0f474a9ad7f0f5b799a0e1', 'request_id': 'req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:37.665767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe910be-9dcf-44a1-9dfe-80fbc18d43df None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.666240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe910be-9dcf-44a1-9dfe-80fbc18d43df None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.666626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe910be-9dcf-44a1-9dfe-80fbc18d43df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.697364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-cfe910be-9dcf-44a1-9dfe-80fbc18d43df None None] MFA Rules not processed for user `c422cd9b325845e48ae64383b234c04b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:37.697364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cfe910be-9dcf-44a1-9dfe-80fbc18d43df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:37.770511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1007/2016] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:37.775268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe910be-9dcf-44a1-9dfe-80fbc18d43df None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:37.785578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862c7e3f8d0f474a9ad7f0f5b799a0e1', 'request_id': 'req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:37.801451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862c7e3f8d0f474a9ad7f0f5b799a0e1', 'request_id': 'req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:37.821474 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] The token cache is being invalidate because project 862c7e3f8d0f474a9ad7f0f5b799a0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:37.821947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:37.823516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2913ac51-3a34-40ad-8c7a-7a7ccfd0fdbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:37.826330 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1010/2017] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:37 2022] DELETE /identity/v3/projects/862c7e3f8d0f474a9ad7f0f5b799a0e1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:37.832158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16680b53-aca1-4bf1-b194-36e17bb5d924 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.832453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16680b53-aca1-4bf1-b194-36e17bb5d924 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.832733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16680b53-aca1-4bf1-b194-36e17bb5d924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.851636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-16680b53-aca1-4bf1-b194-36e17bb5d924 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:37.853321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-16680b53-aca1-4bf1-b194-36e17bb5d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:37.862712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1011/2018] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:37.864645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe910be-9dcf-44a1-9dfe-80fbc18d43df None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:37.870516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:37.871715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.872082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.872198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9efc1-0d88-4c23-8652-dc54befbb766 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.872471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.872647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9efc1-0d88-4c23-8652-dc54befbb766 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.873301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:37.873576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9efc1-0d88-4c23-8652-dc54befbb766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.875558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.895368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1ee9efc1-0d88-4c23-8652-dc54befbb766 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:37.896614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1ee9efc1-0d88-4c23-8652-dc54befbb766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:37.906300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1012/2019] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:37.911496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9efc1-0d88-4c23-8652-dc54befbb766 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:37.921583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9efc1-0d88-4c23-8652-dc54befbb766 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:37.930384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:37.930804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.931185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.939256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.939256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:37.939256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:37.939256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.947687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1013/2020] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:16:37.951952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:37.963076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e4ab-851d-4bcf-b9b6-38e90465702b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:37.968093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb0e24-37b0-4d26-8ac7-baf621035983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:37.968744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb0e24-37b0-4d26-8ac7-baf621035983 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:37.969265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb0e24-37b0-4d26-8ac7-baf621035983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:37.969507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb0e24-37b0-4d26-8ac7-baf621035983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:37.970809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb0e24-37b0-4d26-8ac7-baf621035983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:37.972814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb0e24-37b0-4d26-8ac7-baf621035983 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:37.990225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:38.031772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1008/2021] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:37 2022] POST /identity/v3/projects => generated 389 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:38.036590 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.038442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:38.109034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197123e-b3b7-4412-bb05-93b23964811a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.121815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805b5f-0a5e-4bd6-97a2-43a2184a7155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.121815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805b5f-0a5e-4bd6-97a2-43a2184a7155 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.121815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805b5f-0a5e-4bd6-97a2-43a2184a7155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.121815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805b5f-0a5e-4bd6-97a2-43a2184a7155 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.122200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8805b5f-0a5e-4bd6-97a2-43a2184a7155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.122200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8805b5f-0a5e-4bd6-97a2-43a2184a7155 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.124891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1014/2022] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:37 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:38.129062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb0e24-37b0-4d26-8ac7-baf621035983 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.201655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb0e24-37b0-4d26-8ac7-baf621035983 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.208594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7dce-0066-44fe-89c8-873eba5ec4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.209371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7dce-0066-44fe-89c8-873eba5ec4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.209874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7dce-0066-44fe-89c8-873eba5ec4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.210376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7dce-0066-44fe-89c8-873eba5ec4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.211158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7dce-0066-44fe-89c8-873eba5ec4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.213251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7dce-0066-44fe-89c8-873eba5ec4c8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.239624 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1009/2023] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:38 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:38.242199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805b5f-0a5e-4bd6-97a2-43a2184a7155 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.251928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805b5f-0a5e-4bd6-97a2-43a2184a7155 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.257437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e787cb8-d244-448c-8fcd-392e57c50336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.258262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e787cb8-d244-448c-8fcd-392e57c50336 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.258555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e787cb8-d244-448c-8fcd-392e57c50336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.259277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e787cb8-d244-448c-8fcd-392e57c50336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.260097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e787cb8-d244-448c-8fcd-392e57c50336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.265053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e787cb8-d244-448c-8fcd-392e57c50336 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.277267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1010/2024] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:38.282927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:38.284665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e787cb8-d244-448c-8fcd-392e57c50336 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.302389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e787cb8-d244-448c-8fcd-392e57c50336 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.303957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02734eb0-11eb-430e-8bc5-b22425c3cdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.304920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734eb0-11eb-430e-8bc5-b22425c3cdb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.305248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734eb0-11eb-430e-8bc5-b22425c3cdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.305735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734eb0-11eb-430e-8bc5-b22425c3cdb6 admin admin] PATH_INFO: `/v3/projects/8b50d8a92d364bab945435cc0c44c78a/users/88b8d2cd6ed54c4caa209f7074ab0826/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.322436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02734eb0-11eb-430e-8bc5-b22425c3cdb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b50d8a92d364bab945435cc0c44c78a, user_id=88b8d2cd6ed54c4caa209f7074ab0826, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.325398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02734eb0-11eb-430e-8bc5-b22425c3cdb6 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.402328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1015/2025] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:38 2022] POST /identity/v3/users => generated 287 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:38.406421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7dce-0066-44fe-89c8-873eba5ec4c8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.417093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7dce-0066-44fe-89c8-873eba5ec4c8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.421791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e14dab-f868-4194-bdfc-b6075554cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.422480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14dab-f868-4194-bdfc-b6075554cb63 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.422767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14dab-f868-4194-bdfc-b6075554cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.423048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14dab-f868-4194-bdfc-b6075554cb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.423755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e14dab-f868-4194-bdfc-b6075554cb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.425350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e14dab-f868-4194-bdfc-b6075554cb63 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.435353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1016/2026] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:38.439998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e14dab-f868-4194-bdfc-b6075554cb63 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.450480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e14dab-f868-4194-bdfc-b6075554cb63 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.508469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85119f2-b5bf-4b4b-ba4c-0a271dfb2b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.508469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85119f2-b5bf-4b4b-ba4c-0a271dfb2b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.508469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85119f2-b5bf-4b4b-ba4c-0a271dfb2b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.508469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85119f2-b5bf-4b4b-ba4c-0a271dfb2b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.508863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85119f2-b5bf-4b4b-ba4c-0a271dfb2b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.508863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85119f2-b5bf-4b4b-ba4c-0a271dfb2b1a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.508863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1017/2027] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:38.511579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85119f2-b5bf-4b4b-ba4c-0a271dfb2b1a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.523941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85119f2-b5bf-4b4b-ba4c-0a271dfb2b1a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.528846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4314aaa-f88c-4f22-b39d-6ce1e069664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.529797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4314aaa-f88c-4f22-b39d-6ce1e069664d admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.530166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4314aaa-f88c-4f22-b39d-6ce1e069664d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.530524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4314aaa-f88c-4f22-b39d-6ce1e069664d admin admin] PATH_INFO: `/v3/projects/f03181b981a348f4abbbe43bf50f2f61/users/11d6334e5a5e42b1bff433aad1efaf35/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.547173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4314aaa-f88c-4f22-b39d-6ce1e069664d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03181b981a348f4abbbe43bf50f2f61, user_id=11d6334e5a5e42b1bff433aad1efaf35, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.549935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4314aaa-f88c-4f22-b39d-6ce1e069664d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.586026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1011/2028] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:38 2022] PUT /identity/v3/projects/8b50d8a92d364bab945435cc0c44c78a/users/88b8d2cd6ed54c4caa209f7074ab0826/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:38.587988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02734eb0-11eb-430e-8bc5-b22425c3cdb6 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.648973 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1018/2029] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:38 2022] PUT /identity/v3/projects/f03181b981a348f4abbbe43bf50f2f61/users/11d6334e5a5e42b1bff433aad1efaf35/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:38.660755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafce4b-050e-43f5-ba75-0d8ea2136f0c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.661283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02734eb0-11eb-430e-8bc5-b22425c3cdb6 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.661673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafce4b-050e-43f5-ba75-0d8ea2136f0c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.662207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafce4b-050e-43f5-ba75-0d8ea2136f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.689644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1bafce4b-050e-43f5-ba75-0d8ea2136f0c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:38.691195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1bafce4b-050e-43f5-ba75-0d8ea2136f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:38.729040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289722ac-596c-4d43-9469-9411631eadea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.729936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289722ac-596c-4d43-9469-9411631eadea admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.730353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289722ac-596c-4d43-9469-9411631eadea admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.730772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289722ac-596c-4d43-9469-9411631eadea admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.731566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289722ac-596c-4d43-9469-9411631eadea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.733250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289722ac-596c-4d43-9469-9411631eadea admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.744308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1012/2030] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:38.748556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289722ac-596c-4d43-9469-9411631eadea admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.765260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289722ac-596c-4d43-9469-9411631eadea admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.766198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc7eff-31cd-4dc6-9a4e-e5061860d0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.767127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7eff-31cd-4dc6-9a4e-e5061860d0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.767420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7eff-31cd-4dc6-9a4e-e5061860d0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.767703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7eff-31cd-4dc6-9a4e-e5061860d0a4 admin admin] PATH_INFO: `/v3/projects/8b50d8a92d364bab945435cc0c44c78a/users/88b8d2cd6ed54c4caa209f7074ab0826/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.770004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc7eff-31cd-4dc6-9a4e-e5061860d0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b50d8a92d364bab945435cc0c44c78a, user_id=88b8d2cd6ed54c4caa209f7074ab0826, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:38.770112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1019/2031] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:38.772749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc7eff-31cd-4dc6-9a4e-e5061860d0a4 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:38.780039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafce4b-050e-43f5-ba75-0d8ea2136f0c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.781733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1bafce4b-050e-43f5-ba75-0d8ea2136f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:38.785812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1013/2032] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:38 2022] PUT /identity/v3/projects/8b50d8a92d364bab945435cc0c44c78a/users/88b8d2cd6ed54c4caa209f7074ab0826/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:38.798926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33ee44-4263-434c-932d-26352d6216ff None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.799266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33ee44-4263-434c-932d-26352d6216ff None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.799562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33ee44-4263-434c-932d-26352d6216ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.833738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7f33ee44-4263-434c-932d-26352d6216ff None None] MFA Rules not processed for user `88b8d2cd6ed54c4caa209f7074ab0826`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:38.835088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7f33ee44-4263-434c-932d-26352d6216ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:38.861844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafce4b-050e-43f5-ba75-0d8ea2136f0c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:38.934037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1014/2033] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:38.942962 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:38.943785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:38.944177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:38.944581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:38.947324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33ee44-4263-434c-932d-26352d6216ff None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:38.951816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7f33ee44-4263-434c-932d-26352d6216ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.044212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.046315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33ee44-4263-434c-932d-26352d6216ff None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.046459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.050634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c58c0-1392-4e6e-8e84-6f7e16756f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.051294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c58c0-1392-4e6e-8e84-6f7e16756f43 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.051590 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c58c0-1392-4e6e-8e84-6f7e16756f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.051870 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c58c0-1392-4e6e-8e84-6f7e16756f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.061370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c58c0-1392-4e6e-8e84-6f7e16756f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.062353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1020/2034] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:39.064263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.064499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c58c0-1392-4e6e-8e84-6f7e16756f43 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.068934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.082567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9d51e-0901-4199-9f2e-6c96b3e366bf service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.089145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.090090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.090376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.090653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] PATH_INFO: `/v3/users/46b0e382c8f8430c9bb7640ca51a74c7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.092054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b0e382c8f8430c9bb7640ca51a74c7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.094202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.108012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1015/2035] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:16:39.269844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c58c0-1392-4e6e-8e84-6f7e16756f43 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.280102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c58c0-1392-4e6e-8e84-6f7e16756f43 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.285501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.286430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.286716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.287018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] PATH_INFO: `/v3/users/c422cd9b325845e48ae64383b234c04b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.288206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c422cd9b325845e48ae64383b234c04b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.290219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.372000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b0e382c8f8430c9bb7640ca51a74c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.379786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b0e382c8f8430c9bb7640ca51a74c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.527245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b0e382c8f8430c9bb7640ca51a74c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.527949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b0e382c8f8430c9bb7640ca51a74c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.528594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4282f1f5-c797-49d4-90d5-911c7930bd1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b0e382c8f8430c9bb7640ca51a74c7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.545125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c422cd9b325845e48ae64383b234c04b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.549125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1021/2036] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:39 2022] DELETE /identity/v3/users/46b0e382c8f8430c9bb7640ca51a74c7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:39.553177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c422cd9b325845e48ae64383b234c04b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.553931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c422cd9b325845e48ae64383b234c04b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.554689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c422cd9b325845e48ae64383b234c04b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.647689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c422cd9b325845e48ae64383b234c04b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:39.671769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1016/2037] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:39 2022] DELETE /identity/v3/users/c422cd9b325845e48ae64383b234c04b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:39.676426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710db03-9472-41f3-bc8b-af221ef6a89a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.676932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710db03-9472-41f3-bc8b-af221ef6a89a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.677033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710db03-9472-41f3-bc8b-af221ef6a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.698406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c710db03-9472-41f3-bc8b-af221ef6a89a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:39.699796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c710db03-9472-41f3-bc8b-af221ef6a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.785745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1022/2038] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:39.799772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.801230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.858631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886172c2-f50f-425c-9c6c-940e349992d8 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.862273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e714c8f-2220-49f0-8d72-550c3ca7ca34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.862931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e714c8f-2220-49f0-8d72-550c3ca7ca34 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.863216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e714c8f-2220-49f0-8d72-550c3ca7ca34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.863495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e714c8f-2220-49f0-8d72-550c3ca7ca34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.872540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e714c8f-2220-49f0-8d72-550c3ca7ca34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.874203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e714c8f-2220-49f0-8d72-550c3ca7ca34 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:39.878178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710db03-9472-41f3-bc8b-af221ef6a89a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:39.879944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c710db03-9472-41f3-bc8b-af221ef6a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:39.885390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1017/2039] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:39.908380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710db03-9472-41f3-bc8b-af221ef6a89a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:39.918444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:39.919379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:39.919739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:39.920090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] PATH_INFO: `/v3/projects/5e3344f3dfdc426fbbb2005f4681b2b0` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:39.921341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3344f3dfdc426fbbb2005f4681b2b0)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:39.923371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:40.031190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:40.034364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3344f3dfdc426fbbb2005f4681b2b0', 'request_id': 'req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.138658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3344f3dfdc426fbbb2005f4681b2b0', 'request_id': 'req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.145506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3344f3dfdc426fbbb2005f4681b2b0', 'request_id': 'req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.156529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:40.160357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] The token cache is being invalidate because project 5e3344f3dfdc426fbbb2005f4681b2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:40.160660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.161486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42a74560-a8a1-4f8d-ad3c-2c19f14b5eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.163457 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1023/2040] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:39 2022] DELETE /identity/v3/projects/5e3344f3dfdc426fbbb2005f4681b2b0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:40.168433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee6159-ae0b-45be-8eda-e0af67638efb None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.168724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee6159-ae0b-45be-8eda-e0af67638efb None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.169012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee6159-ae0b-45be-8eda-e0af67638efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.191912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-35ee6159-ae0b-45be-8eda-e0af67638efb None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:40.193256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-35ee6159-ae0b-45be-8eda-e0af67638efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:40.279780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1018/2041] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:40.288572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525800-452c-4158-aed9-c65502847c21 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.288873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525800-452c-4158-aed9-c65502847c21 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.289154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47525800-452c-4158-aed9-c65502847c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.313623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-47525800-452c-4158-aed9-c65502847c21 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:40.317068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-47525800-452c-4158-aed9-c65502847c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:40.323009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1024/2042] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:40.327231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee6159-ae0b-45be-8eda-e0af67638efb None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:40.337391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee6159-ae0b-45be-8eda-e0af67638efb None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:40.342065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:40.342736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.343076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.343363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.344164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:40.344431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:40.346656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:40.360695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1019/2043] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:40.364560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525800-452c-4158-aed9-c65502847c21 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:40.374059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47525800-452c-4158-aed9-c65502847c21 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:40.380151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdaf19-18b7-4c14-93dc-b1410e2f2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:40.380978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdaf19-18b7-4c14-93dc-b1410e2f2774 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.381516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdaf19-18b7-4c14-93dc-b1410e2f2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.381620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdaf19-18b7-4c14-93dc-b1410e2f2774 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.382411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdaf19-18b7-4c14-93dc-b1410e2f2774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:40.384607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdaf19-18b7-4c14-93dc-b1410e2f2774 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:40.506293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:40.508017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:40.512390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1025/2044] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:40 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:40.514838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdaf19-18b7-4c14-93dc-b1410e2f2774 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:40.533754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dbdb8-26a5-461b-b64d-e2d1613c7334 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:40.581732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdaf19-18b7-4c14-93dc-b1410e2f2774 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:40.586491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a413-1779-4f17-b9e3-f0904ad1105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:40.587156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a413-1779-4f17-b9e3-f0904ad1105f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.587442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a413-1779-4f17-b9e3-f0904ad1105f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.587719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a413-1779-4f17-b9e3-f0904ad1105f admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.588407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a413-1779-4f17-b9e3-f0904ad1105f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:40.590403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a413-1779-4f17-b9e3-f0904ad1105f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:40.591017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:40.591942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.592236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.592519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] PATH_INFO: `/v3/projects/b84824c4e4884094805200d809cebb39` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.593701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84824c4e4884094805200d809cebb39)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:40.595742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:40.718825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1026/2045] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:40 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:40.719238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a413-1779-4f17-b9e3-f0904ad1105f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:40.734355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a413-1779-4f17-b9e3-f0904ad1105f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:40.739912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e14ac-fa50-477f-8aa3-9f8f2b7c6fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:40.740835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e14ac-fa50-477f-8aa3-9f8f2b7c6fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.741116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e14ac-fa50-477f-8aa3-9f8f2b7c6fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.741399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e14ac-fa50-477f-8aa3-9f8f2b7c6fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.745265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e14ac-fa50-477f-8aa3-9f8f2b7c6fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:40.745265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e14ac-fa50-477f-8aa3-9f8f2b7c6fa5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:40.757502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84824c4e4884094805200d809cebb39', 'request_id': 'req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.758492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1027/2046] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:40.760125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46168bb-8eb1-470e-ab69-2899cc6d4910 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.760236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46168bb-8eb1-470e-ab69-2899cc6d4910 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.760479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46168bb-8eb1-470e-ab69-2899cc6d4910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.764607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84824c4e4884094805200d809cebb39', 'request_id': 'req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.790093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e46168bb-8eb1-470e-ab69-2899cc6d4910 None None] MFA Rules not processed for user `11d6334e5a5e42b1bff433aad1efaf35`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:40.791603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e46168bb-8eb1-470e-ab69-2899cc6d4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:40.856990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1028/2047] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:40.857917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46168bb-8eb1-470e-ab69-2899cc6d4910 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:40.875613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84824c4e4884094805200d809cebb39', 'request_id': 'req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.887297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] The token cache is being invalidate because project b84824c4e4884094805200d809cebb39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:40.892712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.892712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:40.892712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1020/2048] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:40 2022] DELETE /identity/v3/projects/b84824c4e4884094805200d809cebb39 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:40.892712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:40.892712 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:40.923611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46168bb-8eb1-470e-ab69-2899cc6d4910 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:40.930919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:40.931871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.932161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.932435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.933202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:40.934907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:40.946407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1029/2049] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:40.947230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:40.949672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:40.961749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb990151-5e44-4545-8e57-f25be879da31 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:40.966055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebd652-25f5-4006-8e27-6c3fba6c4e9d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:40.967475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:40.968335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.968623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.968899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] PATH_INFO: `/v3/users/88b8d2cd6ed54c4caa209f7074ab0826` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.970213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b8d2cd6ed54c4caa209f7074ab0826)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:40.970927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:40.971625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:40.971947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:40.972224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:40.972719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:40.973083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:40.975029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:41.105342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1021/2050] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:40 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:41.106379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:41.107915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:41.171014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb29f3-2bfb-4b17-b4af-b5de1776cc02 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:41.176116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:41.177002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.177293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.177570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] PATH_INFO: `/v3/projects/eefaadd026c64aa8b5ff299183791d60/users/fdfb49c339794717885be795283d62cb/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.192453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefaadd026c64aa8b5ff299183791d60, user_id=fdfb49c339794717885be795283d62cb, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:41.195214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:41.226500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b8d2cd6ed54c4caa209f7074ab0826'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:41.233404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b8d2cd6ed54c4caa209f7074ab0826'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:41.309621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b8d2cd6ed54c4caa209f7074ab0826'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:41.310396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b8d2cd6ed54c4caa209f7074ab0826'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:41.311276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-21b3e8c1-b62f-4392-91c8-b84e43f6caa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b8d2cd6ed54c4caa209f7074ab0826'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:41.325491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1022/2051] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:41 2022] PUT /identity/v3/projects/eefaadd026c64aa8b5ff299183791d60/users/fdfb49c339794717885be795283d62cb/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:41.325491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:41.325491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:41.325862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:41.335190 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1030/2052] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:40 2022] DELETE /identity/v3/users/88b8d2cd6ed54c4caa209f7074ab0826 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:41.336876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730773c-1963-4251-b072-9ea2589a2cb5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.336876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730773c-1963-4251-b072-9ea2589a2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.337074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730773c-1963-4251-b072-9ea2589a2cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.368827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5730773c-1963-4251-b072-9ea2589a2cb5 None None] MFA Rules not processed for user `fdfb49c339794717885be795283d62cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:41.370150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5730773c-1963-4251-b072-9ea2589a2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:41.410107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971054d9-2508-47a7-a578-ea5a92d39618 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:41.476493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1031/2053] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:41.485996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b428bd-131a-4062-8c31-fcfb9cddfd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:41.485996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b428bd-131a-4062-8c31-fcfb9cddfd69 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.485996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b428bd-131a-4062-8c31-fcfb9cddfd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.486297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b428bd-131a-4062-8c31-fcfb9cddfd69 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.486750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b428bd-131a-4062-8c31-fcfb9cddfd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:41.488702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b428bd-131a-4062-8c31-fcfb9cddfd69 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:41.490021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730773c-1963-4251-b072-9ea2589a2cb5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:41.491587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5730773c-1963-4251-b072-9ea2589a2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:41.574643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730773c-1963-4251-b072-9ea2589a2cb5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:41.583294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1023/2054] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:41 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:41.583465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ed7e-dc1e-40c9-bd18-8e3984e149c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:41.583465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ed7e-dc1e-40c9-bd18-8e3984e149c1 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.583465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ed7e-dc1e-40c9-bd18-8e3984e149c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.583465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ed7e-dc1e-40c9-bd18-8e3984e149c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.585440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:41.590101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b428bd-131a-4062-8c31-fcfb9cddfd69 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:41.593055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323ed7e-dc1e-40c9-bd18-8e3984e149c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:41.595485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323ed7e-dc1e-40c9-bd18-8e3984e149c1 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:41.603504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b428bd-131a-4062-8c31-fcfb9cddfd69 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:41.605944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1032/2055] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:41.608518 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410028b0-906a-43d2-97be-9f5cfa3b9271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:41.609296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410028b0-906a-43d2-97be-9f5cfa3b9271 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.609589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410028b0-906a-43d2-97be-9f5cfa3b9271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.609892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410028b0-906a-43d2-97be-9f5cfa3b9271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.611206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410028b0-906a-43d2-97be-9f5cfa3b9271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:41.612811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410028b0-906a-43d2-97be-9f5cfa3b9271 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:41.626025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1024/2056] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:41.627928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ed7e-dc1e-40c9-bd18-8e3984e149c1 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:41.646172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ed7e-dc1e-40c9-bd18-8e3984e149c1 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:41.651551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbb8cf-2fbc-4d90-84dc-32530d5fc25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:41.652443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbb8cf-2fbc-4d90-84dc-32530d5fc25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.652722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbb8cf-2fbc-4d90-84dc-32530d5fc25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.653002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbb8cf-2fbc-4d90-84dc-32530d5fc25e admin admin] PATH_INFO: `/v3/projects/c3cb75725671472ab2a39207bfe1497f/users/9d5359c194914db5b0ae660284660c37/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.670213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbb8cf-2fbc-4d90-84dc-32530d5fc25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cb75725671472ab2a39207bfe1497f, user_id=9d5359c194914db5b0ae660284660c37, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:41.673001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbb8cf-2fbc-4d90-84dc-32530d5fc25e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:41.761648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1033/2057] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:41 2022] PUT /identity/v3/projects/c3cb75725671472ab2a39207bfe1497f/users/9d5359c194914db5b0ae660284660c37/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:41.765747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410028b0-906a-43d2-97be-9f5cfa3b9271 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:41.776258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410028b0-906a-43d2-97be-9f5cfa3b9271 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:41.834311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:41.834986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.835270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.835549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.836320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:41.837937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:41.848986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1025/2058] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:41.852930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbb8cf-2fbc-4d90-84dc-32530d5fc25e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:41.863274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbb8cf-2fbc-4d90-84dc-32530d5fc25e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:41.867899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ecc3e-a0b1-419f-ba85-86f49b6a8781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:41.868821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ecc3e-a0b1-419f-ba85-86f49b6a8781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.869107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ecc3e-a0b1-419f-ba85-86f49b6a8781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.869387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ecc3e-a0b1-419f-ba85-86f49b6a8781 admin admin] PATH_INFO: `/v3/projects/c3cb75725671472ab2a39207bfe1497f/users/9d5359c194914db5b0ae660284660c37/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.871466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ecc3e-a0b1-419f-ba85-86f49b6a8781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cb75725671472ab2a39207bfe1497f, user_id=9d5359c194914db5b0ae660284660c37, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:41.878172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ecc3e-a0b1-419f-ba85-86f49b6a8781 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:41.880897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:41.885509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:41.890899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1034/2059] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:41 2022] PUT /identity/v3/projects/c3cb75725671472ab2a39207bfe1497f/users/9d5359c194914db5b0ae660284660c37/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:41.904714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f400f-5bc4-4652-940f-cf4476617b07 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:41.963958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:41.964748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:41.965039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:41.965323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] PATH_INFO: `/v3/projects/8b50d8a92d364bab945435cc0c44c78a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:41.966574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b50d8a92d364bab945435cc0c44c78a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:41.968534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:42.112329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b50d8a92d364bab945435cc0c44c78a', 'request_id': 'req-14f493c6-de41-4266-b895-3f7800cc11b8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:42.119125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b50d8a92d364bab945435cc0c44c78a', 'request_id': 'req-14f493c6-de41-4266-b895-3f7800cc11b8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:42.236170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b50d8a92d364bab945435cc0c44c78a', 'request_id': 'req-14f493c6-de41-4266-b895-3f7800cc11b8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:42.247977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] The token cache is being invalidate because project 8b50d8a92d364bab945435cc0c44c78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:42.248326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:42.249048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14f493c6-de41-4266-b895-3f7800cc11b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:42.250667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1026/2060] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:41 2022] DELETE /identity/v3/projects/8b50d8a92d364bab945435cc0c44c78a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:42.255891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551d8b-2338-4cbb-a4fc-f5ae9d80db02 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:42.256287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551d8b-2338-4cbb-a4fc-f5ae9d80db02 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:42.256566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551d8b-2338-4cbb-a4fc-f5ae9d80db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:42.280519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6c551d8b-2338-4cbb-a4fc-f5ae9d80db02 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:42.280519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6c551d8b-2338-4cbb-a4fc-f5ae9d80db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:42.341863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1035/2061] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:42.349978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ee699-1835-4a1c-a60f-d0a7c728a291 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:42.350283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ee699-1835-4a1c-a60f-d0a7c728a291 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:42.350557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ee699-1835-4a1c-a60f-d0a7c728a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:42.370752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c76ee699-1835-4a1c-a60f-d0a7c728a291 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:42.371956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c76ee699-1835-4a1c-a60f-d0a7c728a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:42.381796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1027/2062] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:42.386277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551d8b-2338-4cbb-a4fc-f5ae9d80db02 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:42.396240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551d8b-2338-4cbb-a4fc-f5ae9d80db02 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:42.401191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:42.401852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:42.402328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:42.408245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:42.408245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:42.408245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:42.408245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:42.418797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1036/2063] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:42.423740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ee699-1835-4a1c-a60f-d0a7c728a291 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:42.433340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ee699-1835-4a1c-a60f-d0a7c728a291 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:42.438000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da323e7-e446-48af-8a0a-56ca78288d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:42.439438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da323e7-e446-48af-8a0a-56ca78288d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:42.439729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da323e7-e446-48af-8a0a-56ca78288d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:42.440008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da323e7-e446-48af-8a0a-56ca78288d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:42.440698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da323e7-e446-48af-8a0a-56ca78288d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:42.442686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da323e7-e446-48af-8a0a-56ca78288d56 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:42.598612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1028/2064] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:42 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:42.608169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:42.618180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5cb85-11be-405e-b433-406d83e92bdd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:42.725803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8949fcc-35e6-4376-a843-70cd2ef399f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:42.727974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8949fcc-35e6-4376-a843-70cd2ef399f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:42.727974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8949fcc-35e6-4376-a843-70cd2ef399f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:42.727974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8949fcc-35e6-4376-a843-70cd2ef399f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:42.727974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8949fcc-35e6-4376-a843-70cd2ef399f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:42.732241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8949fcc-35e6-4376-a843-70cd2ef399f9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:42.786059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:42.819164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1037/2065] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:42 2022] POST /identity/v3/users => generated 281 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:42.823945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da323e7-e446-48af-8a0a-56ca78288d56 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:42.835109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da323e7-e446-48af-8a0a-56ca78288d56 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:42.840059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71923992-c394-4382-a920-7018026fd179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:42.840912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71923992-c394-4382-a920-7018026fd179 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:42.841271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71923992-c394-4382-a920-7018026fd179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:42.841610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71923992-c394-4382-a920-7018026fd179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:42.842511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71923992-c394-4382-a920-7018026fd179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:42.844071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71923992-c394-4382-a920-7018026fd179 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:42.859669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1029/2066] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:42.861589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8949fcc-35e6-4376-a843-70cd2ef399f9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:42.872347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8949fcc-35e6-4376-a843-70cd2ef399f9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:42.877394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488905dc-2908-4183-abe4-2a0985deee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:42.878119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488905dc-2908-4183-abe4-2a0985deee66 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:42.878410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488905dc-2908-4183-abe4-2a0985deee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:42.878756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488905dc-2908-4183-abe4-2a0985deee66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:42.879615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488905dc-2908-4183-abe4-2a0985deee66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:42.881195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488905dc-2908-4183-abe4-2a0985deee66 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:42.893017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1038/2067] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:42.900452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71923992-c394-4382-a920-7018026fd179 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:42.911386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71923992-c394-4382-a920-7018026fd179 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:42.916556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:42.917572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:42.918060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:42.924779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] PATH_INFO: `/v3/projects/07d4d495b1964d90ae9ee47bf97f6ddc/users/4e59b50f0c9f42a2a547fa0dd0c583fa/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:42.934698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d4d495b1964d90ae9ee47bf97f6ddc, user_id=4e59b50f0c9f42a2a547fa0dd0c583fa, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:42.937547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.070684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1030/2068] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:42 2022] PUT /identity/v3/projects/07d4d495b1964d90ae9ee47bf97f6ddc/users/4e59b50f0c9f42a2a547fa0dd0c583fa/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:43.082188 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6f606-7155-4ee1-8794-81b76d16b1ba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.082483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6f606-7155-4ee1-8794-81b76d16b1ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.082767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6f606-7155-4ee1-8794-81b76d16b1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.108541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f7c6f606-7155-4ee1-8794-81b76d16b1ba None None] MFA Rules not processed for user `4e59b50f0c9f42a2a547fa0dd0c583fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:43.109734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f7c6f606-7155-4ee1-8794-81b76d16b1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.161842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:43.171823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1039/2069] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:43.203863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.205689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.264409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab18290-2eb7-4524-bc02-44d0d659396d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.268764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148241b-614f-4aa1-8655-a10c4a3b1e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.269544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148241b-614f-4aa1-8655-a10c4a3b1e38 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.269835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148241b-614f-4aa1-8655-a10c4a3b1e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.270225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148241b-614f-4aa1-8655-a10c4a3b1e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.279448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148241b-614f-4aa1-8655-a10c4a3b1e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.280934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148241b-614f-4aa1-8655-a10c4a3b1e38 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.290646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1031/2070] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:43.307044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6f606-7155-4ee1-8794-81b76d16b1ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.371256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6f606-7155-4ee1-8794-81b76d16b1ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.376882 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.379831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.379831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.379831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] PATH_INFO: `/v3/users/4e59b50f0c9f42a2a547fa0dd0c583fa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.380076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e59b50f0c9f42a2a547fa0dd0c583fa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.381871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.584852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de3240-bd78-4000-8f06-0d2f558d7e72 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.585195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de3240-bd78-4000-8f06-0d2f558d7e72 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.585480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de3240-bd78-4000-8f06-0d2f558d7e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.594037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e59b50f0c9f42a2a547fa0dd0c583fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:43.609843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e59b50f0c9f42a2a547fa0dd0c583fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:43.621047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-01de3240-bd78-4000-8f06-0d2f558d7e72 None None] MFA Rules not processed for user `9d5359c194914db5b0ae660284660c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:43.622300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-01de3240-bd78-4000-8f06-0d2f558d7e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.698497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e59b50f0c9f42a2a547fa0dd0c583fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:43.699141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e59b50f0c9f42a2a547fa0dd0c583fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:43.699788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5c524993-d7a6-41b9-bf06-92800a5221a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e59b50f0c9f42a2a547fa0dd0c583fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:43.702113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1032/2071] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:43.715703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e07a3-8e80-40ac-b515-10deaca246d9 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.716000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e07a3-8e80-40ac-b515-10deaca246d9 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.716289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e07a3-8e80-40ac-b515-10deaca246d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.722836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1040/2072] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:43 2022] DELETE /identity/v3/users/4e59b50f0c9f42a2a547fa0dd0c583fa => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:43.727420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c838-b2dc-43ba-ad74-0fa04a436f4f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.727627 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c838-b2dc-43ba-ad74-0fa04a436f4f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.727952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3c838-b2dc-43ba-ad74-0fa04a436f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.741432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-de7e07a3-8e80-40ac-b515-10deaca246d9 None None] MFA Rules not processed for user `11d6334e5a5e42b1bff433aad1efaf35`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:43.742780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-de7e07a3-8e80-40ac-b515-10deaca246d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.747023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4cd3c838-b2dc-43ba-ad74-0fa04a436f4f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:43.748249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4cd3c838-b2dc-43ba-ad74-0fa04a436f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.817320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1041/2073] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:43.817938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1033/2074] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:43.826857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e07a3-8e80-40ac-b515-10deaca246d9 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.828391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-de7e07a3-8e80-40ac-b515-10deaca246d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.829578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3c838-b2dc-43ba-ad74-0fa04a436f4f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:43.831029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4cd3c838-b2dc-43ba-ad74-0fa04a436f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.889791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e07a3-8e80-40ac-b515-10deaca246d9 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.893691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.894482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.894777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.895062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.906237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.908258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.918238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1034/2075] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:43.928541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3c838-b2dc-43ba-ad74-0fa04a436f4f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:43.934132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:43.934793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:43.935075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:43.935351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:43.938034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:43.951133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:43.952976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:43.963650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1042/2076] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:44.105760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:44.339997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:44.341510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:44.357733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094f94f-88f7-4ace-90de-d371bfbde024 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:44.367517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:44.368450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:44.370368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:44.370368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] PATH_INFO: `/v3/projects/07d4d495b1964d90ae9ee47bf97f6ddc` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:44.370368 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d4d495b1964d90ae9ee47bf97f6ddc)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:44.372291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:44.557544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d4d495b1964d90ae9ee47bf97f6ddc', 'request_id': 'req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:44.563779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d4d495b1964d90ae9ee47bf97f6ddc', 'request_id': 'req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:44.578854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:44.653519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d4d495b1964d90ae9ee47bf97f6ddc', 'request_id': 'req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:44.672012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] The token cache is being invalidate because project 07d4d495b1964d90ae9ee47bf97f6ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:44.672465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:44.673731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b6f494ba-8cc1-4ae6-bc50-b434537a7c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:44.675853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1035/2077] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:44 2022] DELETE /identity/v3/projects/07d4d495b1964d90ae9ee47bf97f6ddc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:44.984612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:46.224534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:46.836665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:46.869937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:47.052957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:47.121475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:47.538656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:47.681576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:48.195713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:48.294423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:48.858799 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:49.019799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:49.372862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:49.372862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:49.386225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588d287-d3df-4051-92c0-ac4fe33ee536 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:49.441838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:49.442730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:49.443039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:49.443312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] PATH_INFO: `/v3/users/fdfb49c339794717885be795283d62cb` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:49.444492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdfb49c339794717885be795283d62cb)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:49.448229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:49.504422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:49.684949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdfb49c339794717885be795283d62cb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:49.691975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdfb49c339794717885be795283d62cb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:49.795157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdfb49c339794717885be795283d62cb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:49.795823 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdfb49c339794717885be795283d62cb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:49.796506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdfb49c339794717885be795283d62cb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:49.816743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1043/2078] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:49 2022] DELETE /identity/v3/users/fdfb49c339794717885be795283d62cb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:49.821552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9810b-e913-496d-9a6f-674f61bc0c72 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:49.821852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9810b-e913-496d-9a6f-674f61bc0c72 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:49.822216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9810b-e913-496d-9a6f-674f61bc0c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:49.839860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-91d9810b-e913-496d-9a6f-674f61bc0c72 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:49.841068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-91d9810b-e913-496d-9a6f-674f61bc0c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:49.911075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1036/2079] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:49.922365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:49.923857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:49.983842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b268d-85d5-4942-b979-da9cbab2ed21 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:49.987644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac45049-1e41-4dad-b8a9-0a19fbcadc90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:49.988301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45049-1e41-4dad-b8a9-0a19fbcadc90 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:49.988587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45049-1e41-4dad-b8a9-0a19fbcadc90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:49.988865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45049-1e41-4dad-b8a9-0a19fbcadc90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:49.998324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac45049-1e41-4dad-b8a9-0a19fbcadc90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:50.000116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac45049-1e41-4dad-b8a9-0a19fbcadc90 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:50.007633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:50.014922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1044/2080] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:50.367348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:50.396399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:50.654726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9810b-e913-496d-9a6f-674f61bc0c72 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:50.656418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-91d9810b-e913-496d-9a6f-674f61bc0c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:50.671854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9810b-e913-496d-9a6f-674f61bc0c72 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:50.677250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:50.678320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:50.678667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:50.678982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] PATH_INFO: `/v3/projects/eefaadd026c64aa8b5ff299183791d60` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:50.680387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefaadd026c64aa8b5ff299183791d60)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:50.682793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:50.784055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:50.785289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefaadd026c64aa8b5ff299183791d60', 'request_id': 'req-97c75935-ff70-4022-ae65-943309a6d018'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:50.791590 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefaadd026c64aa8b5ff299183791d60', 'request_id': 'req-97c75935-ff70-4022-ae65-943309a6d018'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:50.897070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefaadd026c64aa8b5ff299183791d60', 'request_id': 'req-97c75935-ff70-4022-ae65-943309a6d018'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:50.910536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] The token cache is being invalidate because project eefaadd026c64aa8b5ff299183791d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:50.910846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:50.911585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97c75935-ff70-4022-ae65-943309a6d018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:50.913427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1037/2081] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:50 2022] DELETE /identity/v3/projects/eefaadd026c64aa8b5ff299183791d60 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:50.919669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdecb4c-1b41-4733-b6b2-8e8ee8b76dfc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:50.919963 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdecb4c-1b41-4733-b6b2-8e8ee8b76dfc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:50.920245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdecb4c-1b41-4733-b6b2-8e8ee8b76dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:50.962319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:50.991700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6fdecb4c-1b41-4733-b6b2-8e8ee8b76dfc None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:50.993117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6fdecb4c-1b41-4733-b6b2-8e8ee8b76dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:51.042003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:51.126138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1045/2082] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:51.136137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef742c7-50b7-46fe-840a-11cc32856a23 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:51.136498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef742c7-50b7-46fe-840a-11cc32856a23 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:51.136855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef742c7-50b7-46fe-840a-11cc32856a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:51.157880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-bef742c7-50b7-46fe-840a-11cc32856a23 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:51.159130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bef742c7-50b7-46fe-840a-11cc32856a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:51.167383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1038/2083] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:51.171609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdecb4c-1b41-4733-b6b2-8e8ee8b76dfc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:51.184009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdecb4c-1b41-4733-b6b2-8e8ee8b76dfc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:51.191884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:51.192772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:51.193137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:51.193498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:51.194558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:51.210472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:51.210472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:51.217180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1046/2084] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:51.218523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef742c7-50b7-46fe-840a-11cc32856a23 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:51.229649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef742c7-50b7-46fe-840a-11cc32856a23 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:51.235172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3450b1-e1c2-4022-9f2c-55c95ba6fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:51.235882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3450b1-e1c2-4022-9f2c-55c95ba6fa95 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:51.236204 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3450b1-e1c2-4022-9f2c-55c95ba6fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:51.236532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3450b1-e1c2-4022-9f2c-55c95ba6fa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:51.237341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3450b1-e1c2-4022-9f2c-55c95ba6fa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:51.239921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3450b1-e1c2-4022-9f2c-55c95ba6fa95 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:51.440525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1039/2085] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:51 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:51.443788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:51.454323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e001be2-8792-46b0-9be9-a73d4de7e5a7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:51.510604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff5e8-5567-455f-ab13-9bbf5c945b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:51.511444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff5e8-5567-455f-ab13-9bbf5c945b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:51.511772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff5e8-5567-455f-ab13-9bbf5c945b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:51.512065 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcff5e8-5567-455f-ab13-9bbf5c945b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:51.512768 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcff5e8-5567-455f-ab13-9bbf5c945b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:51.515256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcff5e8-5567-455f-ab13-9bbf5c945b0b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:51.696891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1047/2086] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:51 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:51.698226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3450b1-e1c2-4022-9f2c-55c95ba6fa95 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:51.708945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3450b1-e1c2-4022-9f2c-55c95ba6fa95 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:51.713884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09489ba-9ac9-42c7-9ec0-684514d880cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:51.714620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09489ba-9ac9-42c7-9ec0-684514d880cc admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:51.714910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09489ba-9ac9-42c7-9ec0-684514d880cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:51.715301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09489ba-9ac9-42c7-9ec0-684514d880cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:51.716036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09489ba-9ac9-42c7-9ec0-684514d880cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:51.717767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09489ba-9ac9-42c7-9ec0-684514d880cc admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:51.729211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1040/2087] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:51.733131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff5e8-5567-455f-ab13-9bbf5c945b0b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:51.744218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcff5e8-5567-455f-ab13-9bbf5c945b0b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:51.748842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bed34-f0b6-42ea-8185-62e88009fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:51.749515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bed34-f0b6-42ea-8185-62e88009fedc admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:51.749804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bed34-f0b6-42ea-8185-62e88009fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:51.750462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bed34-f0b6-42ea-8185-62e88009fedc admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:51.750912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bed34-f0b6-42ea-8185-62e88009fedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:51.752573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bed34-f0b6-42ea-8185-62e88009fedc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:51.762921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1048/2088] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:51.767019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09489ba-9ac9-42c7-9ec0-684514d880cc admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:51.776859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09489ba-9ac9-42c7-9ec0-684514d880cc admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:51.782022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e88c-2564-4bb8-80f7-87c20b835324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:51.783188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e88c-2564-4bb8-80f7-87c20b835324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:51.783478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e88c-2564-4bb8-80f7-87c20b835324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:51.783753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e88c-2564-4bb8-80f7-87c20b835324 admin admin] PATH_INFO: `/v3/projects/39ad195bbffc47be8a3a7a0a3a0e43a0/users/2caa30215f984b419aeb618ad9ada7e3/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:51.798844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62e88c-2564-4bb8-80f7-87c20b835324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ad195bbffc47be8a3a7a0a3a0e43a0, user_id=2caa30215f984b419aeb618ad9ada7e3, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:51.801507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62e88c-2564-4bb8-80f7-87c20b835324 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:51.903733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1041/2089] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:51 2022] PUT /identity/v3/projects/39ad195bbffc47be8a3a7a0a3a0e43a0/users/2caa30215f984b419aeb618ad9ada7e3/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:51.915633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967580a-7b54-4429-8709-bab3cb31ef94 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:51.915927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967580a-7b54-4429-8709-bab3cb31ef94 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:51.916211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967580a-7b54-4429-8709-bab3cb31ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:51.942957 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b967580a-7b54-4429-8709-bab3cb31ef94 None None] MFA Rules not processed for user `2caa30215f984b419aeb618ad9ada7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:51.944172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b967580a-7b54-4429-8709-bab3cb31ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:51.998186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:52.006904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1049/2090] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:52.011270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e88c-2564-4bb8-80f7-87c20b835324 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:52.073502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62e88c-2564-4bb8-80f7-87c20b835324 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:52.078144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237df4d-aa6c-4ff2-a916-fd96318df64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:52.079458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237df4d-aa6c-4ff2-a916-fd96318df64f admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:52.079742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237df4d-aa6c-4ff2-a916-fd96318df64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:52.080014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237df4d-aa6c-4ff2-a916-fd96318df64f admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:52.080702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237df4d-aa6c-4ff2-a916-fd96318df64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:52.082640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237df4d-aa6c-4ff2-a916-fd96318df64f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:52.248168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1042/2091] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:52 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:52.253273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967580a-7b54-4429-8709-bab3cb31ef94 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:52.264563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967580a-7b54-4429-8709-bab3cb31ef94 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:52.322153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00f793-d486-4d8c-9b10-b3b5db4497b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:52.322826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00f793-d486-4d8c-9b10-b3b5db4497b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:52.323109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00f793-d486-4d8c-9b10-b3b5db4497b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:52.323387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00f793-d486-4d8c-9b10-b3b5db4497b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:52.324108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00f793-d486-4d8c-9b10-b3b5db4497b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:52.326146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00f793-d486-4d8c-9b10-b3b5db4497b3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:52.464171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1050/2092] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:52 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:52.468110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237df4d-aa6c-4ff2-a916-fd96318df64f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:52.478833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237df4d-aa6c-4ff2-a916-fd96318df64f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:52.483298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095ac42-b4ce-4303-9370-8f6b8be59bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:52.483946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ac42-b4ce-4303-9370-8f6b8be59bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:52.484229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ac42-b4ce-4303-9370-8f6b8be59bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:52.484602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ac42-b4ce-4303-9370-8f6b8be59bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:52.486013 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095ac42-b4ce-4303-9370-8f6b8be59bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:52.487620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095ac42-b4ce-4303-9370-8f6b8be59bd0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:52.497915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1043/2093] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:52.501842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00f793-d486-4d8c-9b10-b3b5db4497b3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:52.511595 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00f793-d486-4d8c-9b10-b3b5db4497b3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:52.516039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049449ad-176e-4dfb-b0b9-bf93f17ca847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:52.516901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049449ad-176e-4dfb-b0b9-bf93f17ca847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:52.517181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049449ad-176e-4dfb-b0b9-bf93f17ca847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:52.517455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049449ad-176e-4dfb-b0b9-bf93f17ca847 admin admin] PATH_INFO: `/v3/projects/16bcf94afde540b1be5bcb99d3df6364/users/c41407d2541a493da1b56b4f9a07971a/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:52.532629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049449ad-176e-4dfb-b0b9-bf93f17ca847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bcf94afde540b1be5bcb99d3df6364, user_id=c41407d2541a493da1b56b4f9a07971a, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:52.535340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049449ad-176e-4dfb-b0b9-bf93f17ca847 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:52.635097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1051/2094] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:52 2022] PUT /identity/v3/projects/16bcf94afde540b1be5bcb99d3df6364/users/c41407d2541a493da1b56b4f9a07971a/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:16:52.639153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095ac42-b4ce-4303-9370-8f6b8be59bd0 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:52.650833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095ac42-b4ce-4303-9370-8f6b8be59bd0 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:52.700666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:52.713796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcaac5-cab5-4281-bd3c-09a52b8dbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:52.714608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcaac5-cab5-4281-bd3c-09a52b8dbfad admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:52.714927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcaac5-cab5-4281-bd3c-09a52b8dbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:52.715252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcaac5-cab5-4281-bd3c-09a52b8dbfad admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:52.716113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcaac5-cab5-4281-bd3c-09a52b8dbfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:52.717826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcaac5-cab5-4281-bd3c-09a52b8dbfad admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:52.729268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1044/2095] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:52.733305 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049449ad-176e-4dfb-b0b9-bf93f17ca847 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:52.744279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049449ad-176e-4dfb-b0b9-bf93f17ca847 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:52.749072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:52.755244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:52.755244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:52.755244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] PATH_INFO: `/v3/projects/16bcf94afde540b1be5bcb99d3df6364/users/c41407d2541a493da1b56b4f9a07971a/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:52.755244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bcf94afde540b1be5bcb99d3df6364, user_id=c41407d2541a493da1b56b4f9a07971a, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:52.756288 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:52.767779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1052/2096] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:52 2022] PUT /identity/v3/projects/16bcf94afde540b1be5bcb99d3df6364/users/c41407d2541a493da1b56b4f9a07971a/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:52.778900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2f3b-c56d-4fb7-a2fa-75f727106b09 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:52.779698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2f3b-c56d-4fb7-a2fa-75f727106b09 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:52.780238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2f3b-c56d-4fb7-a2fa-75f727106b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:52.808475 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-271d2f3b-c56d-4fb7-a2fa-75f727106b09 None None] MFA Rules not processed for user `c41407d2541a493da1b56b4f9a07971a`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:52.809769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-271d2f3b-c56d-4fb7-a2fa-75f727106b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:52.883536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1045/2097] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:16:52.895333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:52.897416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:52.976078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb100-39e4-4685-84de-2768448e8b70 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:52.979790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066b518-980b-4ac3-a843-5348ac746520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:52.980432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b518-980b-4ac3-a843-5348ac746520 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:52.980718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b518-980b-4ac3-a843-5348ac746520 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:52.980998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066b518-980b-4ac3-a843-5348ac746520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:52.990052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066b518-980b-4ac3-a843-5348ac746520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:52.991522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066b518-980b-4ac3-a843-5348ac746520 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:53.000962 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1053/2098] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:54.123802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2f3b-c56d-4fb7-a2fa-75f727106b09 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:54.184851 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2f3b-c56d-4fb7-a2fa-75f727106b09 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:54.189496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:54.190403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:54.190687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:54.190964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] PATH_INFO: `/v3/users/2caa30215f984b419aeb618ad9ada7e3` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:54.192156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2caa30215f984b419aeb618ad9ada7e3)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:54.194190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:54.352376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2caa30215f984b419aeb618ad9ada7e3'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:54.360910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2caa30215f984b419aeb618ad9ada7e3'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:54.361742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2caa30215f984b419aeb618ad9ada7e3'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:54.362600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2caa30215f984b419aeb618ad9ada7e3'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:54.445940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2caa30215f984b419aeb618ad9ada7e3'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:54.451470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:54.465568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1046/2099] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:54 2022] DELETE /identity/v3/users/2caa30215f984b419aeb618ad9ada7e3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:54.471184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94d0b-4f75-4f34-a8f1-6d2a68f4ff44 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:54.471725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94d0b-4f75-4f34-a8f1-6d2a68f4ff44 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:54.471836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94d0b-4f75-4f34-a8f1-6d2a68f4ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:54.491244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d9e94d0b-4f75-4f34-a8f1-6d2a68f4ff44 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:54.492634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d9e94d0b-4f75-4f34-a8f1-6d2a68f4ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:54.526549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:54.558371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1054/2100] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:54.567905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:54.569633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:54.660358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015af973-96db-4fde-bffd-cb5b2d0aefdb admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:54.665414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafaf2f-810b-4be4-9e80-ec519950c84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:54.665414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafaf2f-810b-4be4-9e80-ec519950c84c service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:54.665676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafaf2f-810b-4be4-9e80-ec519950c84c service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:54.666014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafaf2f-810b-4be4-9e80-ec519950c84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:54.676344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafaf2f-810b-4be4-9e80-ec519950c84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:54.678149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafaf2f-810b-4be4-9e80-ec519950c84c service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:54.689823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1047/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:55.117460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e94d0b-4f75-4f34-a8f1-6d2a68f4ff44 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:55.119097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d9e94d0b-4f75-4f34-a8f1-6d2a68f4ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:55.135312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e94d0b-4f75-4f34-a8f1-6d2a68f4ff44 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:55.140680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:55.142239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:55.142534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:55.142817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] PATH_INFO: `/v3/projects/39ad195bbffc47be8a3a7a0a3a0e43a0` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:55.144250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ad195bbffc47be8a3a7a0a3a0e43a0)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:55.146332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:55.310394 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ad195bbffc47be8a3a7a0a3a0e43a0', 'request_id': 'req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.395073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ad195bbffc47be8a3a7a0a3a0e43a0', 'request_id': 'req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.401789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ad195bbffc47be8a3a7a0a3a0e43a0', 'request_id': 'req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.413517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] The token cache is being invalidate because project 39ad195bbffc47be8a3a7a0a3a0e43a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:55.413805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.414471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.416013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1055/2102] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:55 2022] DELETE /identity/v3/projects/39ad195bbffc47be8a3a7a0a3a0e43a0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:55.420258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafaf2f-810b-4be4-9e80-ec519950c84c service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:55.429750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafaf2f-810b-4be4-9e80-ec519950c84c service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:55.486445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:55.487264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:55.487553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:55.487848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] PATH_INFO: `/v3/users/c41407d2541a493da1b56b4f9a07971a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:55.489107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41407d2541a493da1b56b4f9a07971a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:55.491294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:55.696102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41407d2541a493da1b56b4f9a07971a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.704269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41407d2541a493da1b56b4f9a07971a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.705044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41407d2541a493da1b56b4f9a07971a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.705757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41407d2541a493da1b56b4f9a07971a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.767108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7fc3251d-a813-472c-be56-00af16b28c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41407d2541a493da1b56b4f9a07971a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:55.775950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:55.788589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1048/2103] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:55 2022] DELETE /identity/v3/users/c41407d2541a493da1b56b4f9a07971a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:56.236885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:56.238451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:56.253296 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217859-2b07-46c2-ad94-3e1bbf0aeeae admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:56.316431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:56.317386 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:56.317697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:56.318025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] PATH_INFO: `/v3/projects/16bcf94afde540b1be5bcb99d3df6364` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:56.319322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bcf94afde540b1be5bcb99d3df6364)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:56.321569 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:56.452216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bcf94afde540b1be5bcb99d3df6364', 'request_id': 'req-3f0c7636-e832-46f1-873a-46944acf5c76'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:56.497370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bcf94afde540b1be5bcb99d3df6364', 'request_id': 'req-3f0c7636-e832-46f1-873a-46944acf5c76'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:56.503845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bcf94afde540b1be5bcb99d3df6364', 'request_id': 'req-3f0c7636-e832-46f1-873a-46944acf5c76'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:56.505073 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:56.514748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] The token cache is being invalidate because project 16bcf94afde540b1be5bcb99d3df6364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:16:56.515034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:56.515691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3f0c7636-e832-46f1-873a-46944acf5c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:56.517268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1056/2104] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:56 2022] DELETE /identity/v3/projects/16bcf94afde540b1be5bcb99d3df6364 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:56.522215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b8dc-1be9-4b5b-ae4a-ab7cf9e2158a None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:56.538618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b8dc-1be9-4b5b-ae4a-ab7cf9e2158a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:56.538618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b8dc-1be9-4b5b-ae4a-ab7cf9e2158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:56.541168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5882b8dc-1be9-4b5b-ae4a-ab7cf9e2158a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:56.542419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5882b8dc-1be9-4b5b-ae4a-ab7cf9e2158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:56.600206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1049/2105] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:56.607741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76333-8e8b-4f71-8111-c2c2520fe1f9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:56.608034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76333-8e8b-4f71-8111-c2c2520fe1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:56.608338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76333-8e8b-4f71-8111-c2c2520fe1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:56.626332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-01d76333-8e8b-4f71-8111-c2c2520fe1f9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:56.627518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-01d76333-8e8b-4f71-8111-c2c2520fe1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:56.635471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1057/2106] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:56.639597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882b8dc-1be9-4b5b-ae4a-ab7cf9e2158a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:56.651538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882b8dc-1be9-4b5b-ae4a-ab7cf9e2158a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:56.656632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:56.658317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:56.658651 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:56.658977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:56.659709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:16:56.660082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:56.661807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:56.674414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1050/2107] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:16:56.678528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76333-8e8b-4f71-8111-c2c2520fe1f9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:56.687746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76333-8e8b-4f71-8111-c2c2520fe1f9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:56.692627 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e35d3c-6a1b-48a3-8305-41ed23aae888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:56.693312 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35d3c-6a1b-48a3-8305-41ed23aae888 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:56.693619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35d3c-6a1b-48a3-8305-41ed23aae888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:56.694080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35d3c-6a1b-48a3-8305-41ed23aae888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:56.694779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e35d3c-6a1b-48a3-8305-41ed23aae888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:56.696721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e35d3c-6a1b-48a3-8305-41ed23aae888 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:56.826139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1058/2108] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:56 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:56.830163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:56.840372 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e757826-63cc-4a5b-9e5c-b4d3e7865e2a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:56.896044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a9c36-5b51-4e0c-94e9-596dbe4d401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:56.896704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a9c36-5b51-4e0c-94e9-596dbe4d401c admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:56.896993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a9c36-5b51-4e0c-94e9-596dbe4d401c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:56.897273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a9c36-5b51-4e0c-94e9-596dbe4d401c admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:56.898091 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a9c36-5b51-4e0c-94e9-596dbe4d401c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:56.900026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a9c36-5b51-4e0c-94e9-596dbe4d401c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.026299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1051/2109] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:56 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:16:57.029130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e35d3c-6a1b-48a3-8305-41ed23aae888 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.040163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e35d3c-6a1b-48a3-8305-41ed23aae888 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.044998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41c2b-177a-4724-a989-8d0f49a3ec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.045662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41c2b-177a-4724-a989-8d0f49a3ec3f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.045949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41c2b-177a-4724-a989-8d0f49a3ec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.046258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41c2b-177a-4724-a989-8d0f49a3ec3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.046989 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41c2b-177a-4724-a989-8d0f49a3ec3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.049206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41c2b-177a-4724-a989-8d0f49a3ec3f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.060004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1059/2110] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:57.064585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a9c36-5b51-4e0c-94e9-596dbe4d401c admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.074872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a9c36-5b51-4e0c-94e9-596dbe4d401c admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.081362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4d06d-b5bb-412d-8272-7be81de0e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.082186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4d06d-b5bb-412d-8272-7be81de0e341 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.082485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4d06d-b5bb-412d-8272-7be81de0e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.082765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4d06d-b5bb-412d-8272-7be81de0e341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.083499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4d06d-b5bb-412d-8272-7be81de0e341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.085166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4d06d-b5bb-412d-8272-7be81de0e341 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.096882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1052/2111] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:57.100709 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41c2b-177a-4724-a989-8d0f49a3ec3f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.110854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41c2b-177a-4724-a989-8d0f49a3ec3f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.115612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439950ee-5103-438a-88b4-ab8d9a9f1828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.116540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439950ee-5103-438a-88b4-ab8d9a9f1828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.116824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439950ee-5103-438a-88b4-ab8d9a9f1828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.117099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439950ee-5103-438a-88b4-ab8d9a9f1828 admin admin] PATH_INFO: `/v3/projects/cd4f8c50a560449eb33a8b2d72c74e96/users/079205840c7745678fa2031a06dd113c/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.132746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439950ee-5103-438a-88b4-ab8d9a9f1828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4f8c50a560449eb33a8b2d72c74e96, user_id=079205840c7745678fa2031a06dd113c, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.135496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439950ee-5103-438a-88b4-ab8d9a9f1828 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.207148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1060/2112] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:57 2022] PUT /identity/v3/projects/cd4f8c50a560449eb33a8b2d72c74e96/users/079205840c7745678fa2031a06dd113c/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:57.218535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a7823-e49e-4556-884a-8cc1ec80251f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.218886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a7823-e49e-4556-884a-8cc1ec80251f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.219177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a7823-e49e-4556-884a-8cc1ec80251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.247979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-1b2a7823-e49e-4556-884a-8cc1ec80251f None None] MFA Rules not processed for user `079205840c7745678fa2031a06dd113c`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:57.249289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1b2a7823-e49e-4556-884a-8cc1ec80251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:57.296751 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:57.317674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1053/2113] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:57.322142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439950ee-5103-438a-88b4-ab8d9a9f1828 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.384477 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439950ee-5103-438a-88b4-ab8d9a9f1828 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.389241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6491ed-2aca-4b7b-bbdb-115c7ac69371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.389904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6491ed-2aca-4b7b-bbdb-115c7ac69371 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.390227 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6491ed-2aca-4b7b-bbdb-115c7ac69371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.390507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6491ed-2aca-4b7b-bbdb-115c7ac69371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.391196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6491ed-2aca-4b7b-bbdb-115c7ac69371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.393599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6491ed-2aca-4b7b-bbdb-115c7ac69371 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.510863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1061/2114] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:16:57 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:57.515197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a7823-e49e-4556-884a-8cc1ec80251f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.529098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a7823-e49e-4556-884a-8cc1ec80251f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.596727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d965c-1183-4f81-8e88-6ec211386f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.597823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d965c-1183-4f81-8e88-6ec211386f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.598322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d965c-1183-4f81-8e88-6ec211386f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.598727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d965c-1183-4f81-8e88-6ec211386f69 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.599839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d965c-1183-4f81-8e88-6ec211386f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.601899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d965c-1183-4f81-8e88-6ec211386f69 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.697019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1054/2115] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:16:57 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:16:57.698480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6491ed-2aca-4b7b-bbdb-115c7ac69371 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.710105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6491ed-2aca-4b7b-bbdb-115c7ac69371 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.715122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae15e92-4921-43d2-9f9f-e16a9d303d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.715922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae15e92-4921-43d2-9f9f-e16a9d303d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.716215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae15e92-4921-43d2-9f9f-e16a9d303d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.716514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae15e92-4921-43d2-9f9f-e16a9d303d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.717231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae15e92-4921-43d2-9f9f-e16a9d303d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.718888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae15e92-4921-43d2-9f9f-e16a9d303d99 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.732269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1062/2116] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:16:57.738540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d965c-1183-4f81-8e88-6ec211386f69 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.750851 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d965c-1183-4f81-8e88-6ec211386f69 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.758975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af242c-6860-4baf-98a3-a8b09d5561b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.763905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af242c-6860-4baf-98a3-a8b09d5561b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.763905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af242c-6860-4baf-98a3-a8b09d5561b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.763905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af242c-6860-4baf-98a3-a8b09d5561b4 admin admin] PATH_INFO: `/v3/projects/3803e73f23a845a8b2a69d8681b08626/users/246e64d91d634ea19e0aec54662ade3c/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.779591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af242c-6860-4baf-98a3-a8b09d5561b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3803e73f23a845a8b2a69d8681b08626, user_id=246e64d91d634ea19e0aec54662ade3c, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.783244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af242c-6860-4baf-98a3-a8b09d5561b4 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.879213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1055/2117] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:57 2022] PUT /identity/v3/projects/3803e73f23a845a8b2a69d8681b08626/users/246e64d91d634ea19e0aec54662ade3c/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:57.883249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae15e92-4921-43d2-9f9f-e16a9d303d99 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.897089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae15e92-4921-43d2-9f9f-e16a9d303d99 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.958391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11947925-6c12-434f-bd95-db0d9dbae160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.959236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947925-6c12-434f-bd95-db0d9dbae160 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.959528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947925-6c12-434f-bd95-db0d9dbae160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.959844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11947925-6c12-434f-bd95-db0d9dbae160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.960606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11947925-6c12-434f-bd95-db0d9dbae160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.962345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11947925-6c12-434f-bd95-db0d9dbae160 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:57.963587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:57.972542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1063/2118] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:16:57.978084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af242c-6860-4baf-98a3-a8b09d5561b4 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:57.988454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af242c-6860-4baf-98a3-a8b09d5561b4 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:57.993080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:57.994039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:57.994365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:57.994647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] PATH_INFO: `/v3/projects/3803e73f23a845a8b2a69d8681b08626/users/246e64d91d634ea19e0aec54662ade3c/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:57.996835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3803e73f23a845a8b2a69d8681b08626, user_id=246e64d91d634ea19e0aec54662ade3c, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:57.999791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:58.012046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1056/2119] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:16:57 2022] PUT /identity/v3/projects/3803e73f23a845a8b2a69d8681b08626/users/246e64d91d634ea19e0aec54662ade3c/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:58.024631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e168351-2a18-4b56-b400-a4e2aafbf1df None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:58.024930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e168351-2a18-4b56-b400-a4e2aafbf1df None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:58.025218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e168351-2a18-4b56-b400-a4e2aafbf1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:58.051338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8e168351-2a18-4b56-b400-a4e2aafbf1df None None] MFA Rules not processed for user `246e64d91d634ea19e0aec54662ade3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:58.052561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8e168351-2a18-4b56-b400-a4e2aafbf1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:58.120543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1064/2120] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:58.132578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:58.134322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:58.201033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de981da-e37a-4753-b96b-b83e2083947a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:58.205493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74d561-7746-498c-9830-c0c95165388f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:58.206287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74d561-7746-498c-9830-c0c95165388f service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:58.206741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74d561-7746-498c-9830-c0c95165388f service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:58.207081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74d561-7746-498c-9830-c0c95165388f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:58.217112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74d561-7746-498c-9830-c0c95165388f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:58.218612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74d561-7746-498c-9830-c0c95165388f service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:58.228489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1057/2121] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:58.370759 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e168351-2a18-4b56-b400-a4e2aafbf1df None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:58.380318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e168351-2a18-4b56-b400-a4e2aafbf1df None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:58.383909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a77b29-b669-43b2-8f35-c85d3dd28bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:58.384546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77b29-b669-43b2-8f35-c85d3dd28bdd service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:58.384841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77b29-b669-43b2-8f35-c85d3dd28bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:58.385218 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77b29-b669-43b2-8f35-c85d3dd28bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:58.441903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77b29-b669-43b2-8f35-c85d3dd28bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:58.443418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a77b29-b669-43b2-8f35-c85d3dd28bdd service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:58.452502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1065/2122] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:58.889739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74d561-7746-498c-9830-c0c95165388f service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:58.932904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:58.952525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74d561-7746-498c-9830-c0c95165388f service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:58.957609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:58.958508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:58.958793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:58.959070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] PATH_INFO: `/v3/users/079205840c7745678fa2031a06dd113c` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:58.960246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=079205840c7745678fa2031a06dd113c)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:58.962230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:59.152834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079205840c7745678fa2031a06dd113c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:59.161642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079205840c7745678fa2031a06dd113c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:59.162356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079205840c7745678fa2031a06dd113c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:59.162990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079205840c7745678fa2031a06dd113c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:59.245728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079205840c7745678fa2031a06dd113c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:16:59.263480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1058/2123] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:16:58 2022] DELETE /identity/v3/users/079205840c7745678fa2031a06dd113c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:16:59.268610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d7b26-58d5-431b-934c-752c03d07c61 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:59.268911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d7b26-58d5-431b-934c-752c03d07c61 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:59.269206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d7b26-58d5-431b-934c-752c03d07c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:59.286282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-956d7b26-58d5-431b-934c-752c03d07c61 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:16:59.287455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-956d7b26-58d5-431b-934c-752c03d07c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:59.345567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1066/2124] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:16:59.355055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:59.356489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:59.414865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a91b2-658d-4762-abfc-555eb3efbcfe admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:59.418426 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e874-0499-4e67-aaa1-ebb9be2c0c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:59.419075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e874-0499-4e67-aaa1-ebb9be2c0c5d service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:59.419361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e874-0499-4e67-aaa1-ebb9be2c0c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:59.419642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e874-0499-4e67-aaa1-ebb9be2c0c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:59.429432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931e874-0499-4e67-aaa1-ebb9be2c0c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:59.430979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931e874-0499-4e67-aaa1-ebb9be2c0c5d service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:59.440785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1059/2125] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:16:59.858664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d7b26-58d5-431b-934c-752c03d07c61 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:16:59.860182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-956d7b26-58d5-431b-934c-752c03d07c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:16:59.877801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d7b26-58d5-431b-934c-752c03d07c61 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:16:59.877801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:16:59.877801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:16:59.877801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:16:59.878630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] PATH_INFO: `/v3/projects/cd4f8c50a560449eb33a8b2d72c74e96` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:16:59.879526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4f8c50a560449eb33a8b2d72c74e96)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:16:59.881617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:16:59.900752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:00.018426 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4f8c50a560449eb33a8b2d72c74e96', 'request_id': 'req-c03e685b-d308-4337-997b-abc5120889a2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.097217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4f8c50a560449eb33a8b2d72c74e96', 'request_id': 'req-c03e685b-d308-4337-997b-abc5120889a2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.103717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4f8c50a560449eb33a8b2d72c74e96', 'request_id': 'req-c03e685b-d308-4337-997b-abc5120889a2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.113754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] The token cache is being invalidate because project cd4f8c50a560449eb33a8b2d72c74e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:00.114079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.114703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.116362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1067/2126] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:16:59 2022] DELETE /identity/v3/projects/cd4f8c50a560449eb33a8b2d72c74e96 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:00.120418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e874-0499-4e67-aaa1-ebb9be2c0c5d service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:00.130473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e874-0499-4e67-aaa1-ebb9be2c0c5d service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:00.185775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:00.186602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:00.186889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:00.187159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] PATH_INFO: `/v3/users/246e64d91d634ea19e0aec54662ade3c` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:00.188354 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246e64d91d634ea19e0aec54662ade3c)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:00.190838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:00.193105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:00.401484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246e64d91d634ea19e0aec54662ade3c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.409469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246e64d91d634ea19e0aec54662ade3c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.410201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246e64d91d634ea19e0aec54662ade3c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.410884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246e64d91d634ea19e0aec54662ade3c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.480614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-9d4912ea-ec53-4495-a89f-22bc154c49f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246e64d91d634ea19e0aec54662ade3c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:00.500867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1060/2127] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:17:00 2022] DELETE /identity/v3/users/246e64d91d634ea19e0aec54662ade3c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:00.989289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:00.989289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:01.014111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e685b-d308-4337-997b-abc5120889a2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:01.078015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:01.079022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.079938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.080236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] PATH_INFO: `/v3/projects/3803e73f23a845a8b2a69d8681b08626` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.081557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3803e73f23a845a8b2a69d8681b08626)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:01.083765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:01.193877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3803e73f23a845a8b2a69d8681b08626', 'request_id': 'req-3a2dc7af-adbe-45b9-b186-6311bca02458'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:01.315007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3803e73f23a845a8b2a69d8681b08626', 'request_id': 'req-3a2dc7af-adbe-45b9-b186-6311bca02458'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:01.321827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3803e73f23a845a8b2a69d8681b08626', 'request_id': 'req-3a2dc7af-adbe-45b9-b186-6311bca02458'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:01.332776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] The token cache is being invalidate because project 3803e73f23a845a8b2a69d8681b08626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:01.333063 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:01.333691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3a2dc7af-adbe-45b9-b186-6311bca02458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:01.335255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1068/2128] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:17:00 2022] DELETE /identity/v3/projects/3803e73f23a845a8b2a69d8681b08626 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:01.340999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011ae3-017f-48a9-a27d-4ad616671e8f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.341469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011ae3-017f-48a9-a27d-4ad616671e8f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.341586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011ae3-017f-48a9-a27d-4ad616671e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.360376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f8011ae3-017f-48a9-a27d-4ad616671e8f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:01.361587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f8011ae3-017f-48a9-a27d-4ad616671e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:01.422644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1061/2129] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:01.430489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa460-4bbb-4602-a2f1-92dd08b4b793 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.430785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa460-4bbb-4602-a2f1-92dd08b4b793 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.431070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa460-4bbb-4602-a2f1-92dd08b4b793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.449562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8fbaa460-4bbb-4602-a2f1-92dd08b4b793 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:01.450832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8fbaa460-4bbb-4602-a2f1-92dd08b4b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:01.459396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1069/2130] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:01.463570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011ae3-017f-48a9-a27d-4ad616671e8f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:01.473101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011ae3-017f-48a9-a27d-4ad616671e8f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:01.477642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:01.478319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.478605 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.478922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.479641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:17:01.479946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:01.481551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:01.493342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1062/2131] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:17:01.497459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa460-4bbb-4602-a2f1-92dd08b4b793 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:01.507382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa460-4bbb-4602-a2f1-92dd08b4b793 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:01.511997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8138-0240-45e6-b281-5493a0c60426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:01.512636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8138-0240-45e6-b281-5493a0c60426 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.513026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8138-0240-45e6-b281-5493a0c60426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.513308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8138-0240-45e6-b281-5493a0c60426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.514010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc8138-0240-45e6-b281-5493a0c60426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:01.518401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc8138-0240-45e6-b281-5493a0c60426 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:01.585261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1070/2132] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:17:01 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:17:01.589575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:01.599723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b58831-dc6a-4633-aeac-fed0c99242b9 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:01.662131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aedb1-5c1c-4e09-987c-87218368e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:01.662840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aedb1-5c1c-4e09-987c-87218368e89e admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.663127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aedb1-5c1c-4e09-987c-87218368e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.663424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aedb1-5c1c-4e09-987c-87218368e89e admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.664141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aedb1-5c1c-4e09-987c-87218368e89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:01.666121 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aedb1-5c1c-4e09-987c-87218368e89e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:01.755628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:01.765695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1063/2133] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:17:01 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:17:01.767715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8138-0240-45e6-b281-5493a0c60426 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:01.775431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:01.779459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8138-0240-45e6-b281-5493a0c60426 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:01.785279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2033bfe-92bc-4a70-9092-a38e0029dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:01.788214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2033bfe-92bc-4a70-9092-a38e0029dd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.788591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2033bfe-92bc-4a70-9092-a38e0029dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.788952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2033bfe-92bc-4a70-9092-a38e0029dd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.789703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2033bfe-92bc-4a70-9092-a38e0029dd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:01.791534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2033bfe-92bc-4a70-9092-a38e0029dd2c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:01.802507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1071/2134] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:01.806597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aedb1-5c1c-4e09-987c-87218368e89e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:01.818165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aedb1-5c1c-4e09-987c-87218368e89e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:01.823315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a133b-0b6e-49c7-bfd2-b2a797e06481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:01.823985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a133b-0b6e-49c7-bfd2-b2a797e06481 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.824274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a133b-0b6e-49c7-bfd2-b2a797e06481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.824552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a133b-0b6e-49c7-bfd2-b2a797e06481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.825281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a133b-0b6e-49c7-bfd2-b2a797e06481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:01.826930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a133b-0b6e-49c7-bfd2-b2a797e06481 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:01.839984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1064/2135] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:01.844038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2033bfe-92bc-4a70-9092-a38e0029dd2c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:01.854232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2033bfe-92bc-4a70-9092-a38e0029dd2c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:01.859013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:01.860055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.860864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.861149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] PATH_INFO: `/v3/projects/69e01fe00a644607ab21138a0f5f6142/users/a887692d21ed415a96fc2a18786ce52f/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.876790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e01fe00a644607ab21138a0f5f6142, user_id=a887692d21ed415a96fc2a18786ce52f, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:01.879706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:01.949503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1072/2136] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:17:01 2022] PUT /identity/v3/projects/69e01fe00a644607ab21138a0f5f6142/users/a887692d21ed415a96fc2a18786ce52f/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:01.962384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3889e5-5aeb-4faa-ac68-abf8bee86193 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:01.962681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3889e5-5aeb-4faa-ac68-abf8bee86193 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:01.962964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3889e5-5aeb-4faa-ac68-abf8bee86193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:01.993439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-de3889e5-5aeb-4faa-ac68-abf8bee86193 None None] MFA Rules not processed for user `a887692d21ed415a96fc2a18786ce52f`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:01.994680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-de3889e5-5aeb-4faa-ac68-abf8bee86193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:02.065436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1065/2137] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:02.076578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:02.083013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:02.134864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595fb5c-4ab1-403c-a34c-e1fe0ee7fdec admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:02.138412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce8da9-94e8-466d-9ccc-2e4276bdf2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:02.139048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce8da9-94e8-466d-9ccc-2e4276bdf2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:02.139331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce8da9-94e8-466d-9ccc-2e4276bdf2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:02.139606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce8da9-94e8-466d-9ccc-2e4276bdf2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:02.147869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce8da9-94e8-466d-9ccc-2e4276bdf2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:02.149310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce8da9-94e8-466d-9ccc-2e4276bdf2b9 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:02.158760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1073/2138] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:02.185064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3889e5-5aeb-4faa-ac68-abf8bee86193 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:02.256436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3889e5-5aeb-4faa-ac68-abf8bee86193 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:02.261135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:02.262141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:02.262436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:02.262717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] PATH_INFO: `/v3/users/a887692d21ed415a96fc2a18786ce52f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:02.263931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a887692d21ed415a96fc2a18786ce52f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:02.265891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:02.545846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a887692d21ed415a96fc2a18786ce52f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:02.554024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a887692d21ed415a96fc2a18786ce52f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:02.554701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a887692d21ed415a96fc2a18786ce52f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:02.555317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a887692d21ed415a96fc2a18786ce52f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:02.635203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a887692d21ed415a96fc2a18786ce52f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:02.647758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:02.653185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1066/2139] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:17:02 2022] DELETE /identity/v3/users/a887692d21ed415a96fc2a18786ce52f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:02.658655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd97d3-2217-4634-a8eb-1dbb9f004b2a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:02.658952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd97d3-2217-4634-a8eb-1dbb9f004b2a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:02.659232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd97d3-2217-4634-a8eb-1dbb9f004b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:02.676061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-11cd97d3-2217-4634-a8eb-1dbb9f004b2a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:02.677250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-11cd97d3-2217-4634-a8eb-1dbb9f004b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:02.736585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1074/2140] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:17:02.746476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:02.748126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:02.808424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d4fd-b6a1-4fa9-8e1e-17073d0f471b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:02.812028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdf692-8e8b-4956-96df-589f3c48f702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:02.812667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdf692-8e8b-4956-96df-589f3c48f702 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:02.812954 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdf692-8e8b-4956-96df-589f3c48f702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:02.813233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdf692-8e8b-4956-96df-589f3c48f702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:02.822442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdf692-8e8b-4956-96df-589f3c48f702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:02.824141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdf692-8e8b-4956-96df-589f3c48f702 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:02.835254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1067/2141] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:03.310392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd97d3-2217-4634-a8eb-1dbb9f004b2a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:03.312009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-11cd97d3-2217-4634-a8eb-1dbb9f004b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:03.329129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd97d3-2217-4634-a8eb-1dbb9f004b2a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:03.335898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:03.335898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:03.335898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:03.335898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] PATH_INFO: `/v3/projects/69e01fe00a644607ab21138a0f5f6142` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:03.337074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e01fe00a644607ab21138a0f5f6142)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:03.339059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:03.481199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e01fe00a644607ab21138a0f5f6142', 'request_id': 'req-d9eb48e3-8d87-4d48-b403-86729f233ea8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:03.588763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e01fe00a644607ab21138a0f5f6142', 'request_id': 'req-d9eb48e3-8d87-4d48-b403-86729f233ea8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:03.595550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e01fe00a644607ab21138a0f5f6142', 'request_id': 'req-d9eb48e3-8d87-4d48-b403-86729f233ea8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:03.601162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:03.607349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] The token cache is being invalidate because project 69e01fe00a644607ab21138a0f5f6142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:03.607640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:03.608283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d9eb48e3-8d87-4d48-b403-86729f233ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:03.609861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1075/2142] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:17:03 2022] DELETE /identity/v3/projects/69e01fe00a644607ab21138a0f5f6142 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:03.615293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077519-7989-478b-8053-6e7fda32272a None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:03.615838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077519-7989-478b-8053-6e7fda32272a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:03.615838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2077519-7989-478b-8053-6e7fda32272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:03.635793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-a2077519-7989-478b-8053-6e7fda32272a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:03.637309 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a2077519-7989-478b-8053-6e7fda32272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:03.702497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1068/2143] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:03.710205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487ce6-497c-43c1-a451-aebb7a0bd9b2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:03.710619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487ce6-497c-43c1-a451-aebb7a0bd9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:03.710927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487ce6-497c-43c1-a451-aebb7a0bd9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:03.729516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bc487ce6-497c-43c1-a451-aebb7a0bd9b2 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:03.730776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bc487ce6-497c-43c1-a451-aebb7a0bd9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:03.739368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1076/2144] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:03.743957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077519-7989-478b-8053-6e7fda32272a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:03.755858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2077519-7989-478b-8053-6e7fda32272a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:03.761903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:03.762710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:03.763050 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:03.763377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:03.764157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:17:03.764509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:03.766441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:03.779535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1069/2145] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:17:03.784783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc487ce6-497c-43c1-a451-aebb7a0bd9b2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:03.795466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc487ce6-497c-43c1-a451-aebb7a0bd9b2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:03.801233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df262f9-68c1-4285-8d35-9f9941778471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:03.801919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df262f9-68c1-4285-8d35-9f9941778471 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:03.802241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df262f9-68c1-4285-8d35-9f9941778471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:03.802559 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df262f9-68c1-4285-8d35-9f9941778471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:03.803322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df262f9-68c1-4285-8d35-9f9941778471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:03.805532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df262f9-68c1-4285-8d35-9f9941778471 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:03.888138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1077/2146] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:17:03 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:17:03.892187 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:03.902692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57818d-deba-401c-971c-ebd03d1afd03 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:03.959027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eab915-0602-4886-97a7-61f05fb4afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:03.959618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab915-0602-4886-97a7-61f05fb4afe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:03.959904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab915-0602-4886-97a7-61f05fb4afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:03.960183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab915-0602-4886-97a7-61f05fb4afe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:03.960860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eab915-0602-4886-97a7-61f05fb4afe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:03.962821 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eab915-0602-4886-97a7-61f05fb4afe7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:04.023431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1070/2147] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:17:03 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:17:04.027552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df262f9-68c1-4285-8d35-9f9941778471 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:04.040396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df262f9-68c1-4285-8d35-9f9941778471 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:04.045682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ed9fa-caea-4864-b580-001899def303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:04.046463 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ed9fa-caea-4864-b580-001899def303 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:04.046761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ed9fa-caea-4864-b580-001899def303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:04.047089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ed9fa-caea-4864-b580-001899def303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:04.047912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ed9fa-caea-4864-b580-001899def303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:04.050649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ed9fa-caea-4864-b580-001899def303 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:04.062489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1078/2148] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:04.066356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eab915-0602-4886-97a7-61f05fb4afe7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:04.076167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eab915-0602-4886-97a7-61f05fb4afe7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:04.081212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0371cb-8dce-468d-9bb6-303d7f3af1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:04.081859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0371cb-8dce-468d-9bb6-303d7f3af1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:04.082177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0371cb-8dce-468d-9bb6-303d7f3af1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:04.082457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0371cb-8dce-468d-9bb6-303d7f3af1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:04.083182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0371cb-8dce-468d-9bb6-303d7f3af1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:04.084772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0371cb-8dce-468d-9bb6-303d7f3af1c8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:04.095314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1071/2149] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:04.099894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ed9fa-caea-4864-b580-001899def303 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:04.113250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ed9fa-caea-4864-b580-001899def303 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:04.118098 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:04.119024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:04.119276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:04.119652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] PATH_INFO: `/v3/projects/2f91b658c5884f5eb922acf79c1b9324/users/d05466b6719b435b9a42ce3180cde8d8/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:04.140453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f91b658c5884f5eb922acf79c1b9324, user_id=d05466b6719b435b9a42ce3180cde8d8, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:04.143777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:04.241628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1079/2150] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:17:04 2022] PUT /identity/v3/projects/2f91b658c5884f5eb922acf79c1b9324/users/d05466b6719b435b9a42ce3180cde8d8/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:04.252754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345f428-b3b8-441a-9bb8-e8c1e38ba402 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:04.253120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345f428-b3b8-441a-9bb8-e8c1e38ba402 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:04.253467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345f428-b3b8-441a-9bb8-e8c1e38ba402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:04.260938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:04.279928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9345f428-b3b8-441a-9bb8-e8c1e38ba402 None None] MFA Rules not processed for user `d05466b6719b435b9a42ce3180cde8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:04.281140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9345f428-b3b8-441a-9bb8-e8c1e38ba402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:04.344072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1072/2151] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:04.355343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:04.357047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:04.415575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71621648-1433-4e79-8c70-8b45b00164b6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:04.419220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9077-673b-4b34-be6d-5cbe9b11cf5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:04.419856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9077-673b-4b34-be6d-5cbe9b11cf5d service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:04.420138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9077-673b-4b34-be6d-5cbe9b11cf5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:04.420414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9077-673b-4b34-be6d-5cbe9b11cf5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:04.429022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba9077-673b-4b34-be6d-5cbe9b11cf5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:04.430510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba9077-673b-4b34-be6d-5cbe9b11cf5d service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:04.439294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1080/2152] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:06.267376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345f428-b3b8-441a-9bb8-e8c1e38ba402 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:06.277941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345f428-b3b8-441a-9bb8-e8c1e38ba402 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:06.281701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:06.282634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:06.282918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:06.283191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:06.284980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:06.347695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:06.349148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:06.359666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1073/2153] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:07.264953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46c83-d06e-4489-8356-660483291820 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:07.265529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46c83-d06e-4489-8356-660483291820 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:07.265529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46c83-d06e-4489-8356-660483291820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:07.284496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-14e46c83-d06e-4489-8356-660483291820 None None] MFA Rules not processed for user `d05466b6719b435b9a42ce3180cde8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:07.285808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14e46c83-d06e-4489-8356-660483291820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:07.293087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1081/2154] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:16.354474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=60 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:16.405037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:16.406689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:16.494552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b07f1-d2db-40e1-b1ef-b9002e9fa43f service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:16.509181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:16.509181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:16.509181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:16.509181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] PATH_INFO: `/v3/users/0189d55985cd4f3a8e09079254039209` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:16.509795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0189d55985cd4f3a8e09079254039209)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:16.509795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:16.666045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0189d55985cd4f3a8e09079254039209'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:16.673213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0189d55985cd4f3a8e09079254039209'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:16.673924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0189d55985cd4f3a8e09079254039209'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:16.675035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0189d55985cd4f3a8e09079254039209'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:16.760692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0189d55985cd4f3a8e09079254039209'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:16.779616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1074/2155] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:17:16 2022] DELETE /identity/v3/users/0189d55985cd4f3a8e09079254039209 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:16.784819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d8e5-2860-4074-8ebd-8c32e07e855b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:16.785256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d8e5-2860-4074-8ebd-8c32e07e855b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:16.785391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26d8e5-2860-4074-8ebd-8c32e07e855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:16.803488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6d26d8e5-2860-4074-8ebd-8c32e07e855b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:16.804680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6d26d8e5-2860-4074-8ebd-8c32e07e855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:16.863320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1082/2156] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:16.873271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:16.874674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:16.930462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f21bf-e99f-4c66-87b8-f8a6cb0ae8f8 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:16.933936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22e198-54e1-46a6-8a8d-1d51d0f165b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:16.934601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22e198-54e1-46a6-8a8d-1d51d0f165b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:16.934887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22e198-54e1-46a6-8a8d-1d51d0f165b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:16.935165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22e198-54e1-46a6-8a8d-1d51d0f165b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:16.943945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22e198-54e1-46a6-8a8d-1d51d0f165b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:16.945362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22e198-54e1-46a6-8a8d-1d51d0f165b1 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:16.954650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1075/2157] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:17.395800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26d8e5-2860-4074-8ebd-8c32e07e855b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:17.397335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6d26d8e5-2860-4074-8ebd-8c32e07e855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:17.410346 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26d8e5-2860-4074-8ebd-8c32e07e855b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:17.415760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:17.416646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:17.417058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:17.417348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] PATH_INFO: `/v3/projects/0a787665cd204975b3c75feec1d9f2b7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:17.419037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a787665cd204975b3c75feec1d9f2b7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:17.422492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:17.450365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:17.531266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a787665cd204975b3c75feec1d9f2b7', 'request_id': 'req-51f143a0-e4e0-479a-b9b4-f5af38eb1211'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:17.583654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a787665cd204975b3c75feec1d9f2b7', 'request_id': 'req-51f143a0-e4e0-479a-b9b4-f5af38eb1211'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:17.592762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a787665cd204975b3c75feec1d9f2b7', 'request_id': 'req-51f143a0-e4e0-479a-b9b4-f5af38eb1211'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:17.613191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] The token cache is being invalidate because project 0a787665cd204975b3c75feec1d9f2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:17.613510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:17.614666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-51f143a0-e4e0-479a-b9b4-f5af38eb1211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:17.616938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1083/2158] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:17:17 2022] DELETE /identity/v3/projects/0a787665cd204975b3c75feec1d9f2b7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:17.622079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06834be6-15cd-44fd-8891-b6c88a5914c3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:17.622696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06834be6-15cd-44fd-8891-b6c88a5914c3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:17.623033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06834be6-15cd-44fd-8891-b6c88a5914c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:17.659862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-06834be6-15cd-44fd-8891-b6c88a5914c3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:17.662011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-06834be6-15cd-44fd-8891-b6c88a5914c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:17.677857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:17.757859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1076/2159] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:17:17.768301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f3c3-7f4b-4ddf-98f8-4359b10da1f9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:17.768597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f3c3-7f4b-4ddf-98f8-4359b10da1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:17.768887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f3c3-7f4b-4ddf-98f8-4359b10da1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:17.790901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3b74f3c3-7f4b-4ddf-98f8-4359b10da1f9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:17.792356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3b74f3c3-7f4b-4ddf-98f8-4359b10da1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:17.805310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1084/2160] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:17.806776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06834be6-15cd-44fd-8891-b6c88a5914c3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:17.819682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06834be6-15cd-44fd-8891-b6c88a5914c3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:17.824478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:17.825158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:17.825449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:17.825723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:17.826647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:17:17.826963 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:17.828597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:17.844685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1077/2161] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:17:17.845770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f3c3-7f4b-4ddf-98f8-4359b10da1f9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:17.856342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f3c3-7f4b-4ddf-98f8-4359b10da1f9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:17.861502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e2298-bf18-4b16-972d-11f376a2c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:17.862800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2298-bf18-4b16-972d-11f376a2c30b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:17.863090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2298-bf18-4b16-972d-11f376a2c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:17.863365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2298-bf18-4b16-972d-11f376a2c30b admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:17.864072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e2298-bf18-4b16-972d-11f376a2c30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:17.866043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e2298-bf18-4b16-972d-11f376a2c30b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:17.957815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1085/2162] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:17:17 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:17:17.961699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:17.972935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138183f-286b-4f1a-bf3d-6a837dc6460c admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:18.041860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbbb0a-ef8f-4664-9eee-53151e375f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:18.042630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbbb0a-ef8f-4664-9eee-53151e375f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.042942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbbb0a-ef8f-4664-9eee-53151e375f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.043225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbbb0a-ef8f-4664-9eee-53151e375f50 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.043918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbbb0a-ef8f-4664-9eee-53151e375f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:18.045998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbbb0a-ef8f-4664-9eee-53151e375f50 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:18.145066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1078/2163] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:17:17 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:17:18.148616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e2298-bf18-4b16-972d-11f376a2c30b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:18.159834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e2298-bf18-4b16-972d-11f376a2c30b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:18.164488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970272d5-a6a1-4e96-9624-28e4863abe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:18.165161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970272d5-a6a1-4e96-9624-28e4863abe33 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.165446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970272d5-a6a1-4e96-9624-28e4863abe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.165845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970272d5-a6a1-4e96-9624-28e4863abe33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.166618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970272d5-a6a1-4e96-9624-28e4863abe33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:18.168258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970272d5-a6a1-4e96-9624-28e4863abe33 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:18.181468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1086/2164] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:18.187133 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbbb0a-ef8f-4664-9eee-53151e375f50 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:18.197542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbbb0a-ef8f-4664-9eee-53151e375f50 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:18.203297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4812e3d-9334-4480-89e7-051e63d4b515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:18.203963 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4812e3d-9334-4480-89e7-051e63d4b515 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.204246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4812e3d-9334-4480-89e7-051e63d4b515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.204520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4812e3d-9334-4480-89e7-051e63d4b515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.205347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4812e3d-9334-4480-89e7-051e63d4b515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:18.207002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4812e3d-9334-4480-89e7-051e63d4b515 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:18.218504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1079/2165] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:18.223159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970272d5-a6a1-4e96-9624-28e4863abe33 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:18.233266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970272d5-a6a1-4e96-9624-28e4863abe33 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:18.239024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:18.240006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.240306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.240680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] PATH_INFO: `/v3/projects/bb53f79cf0f440b893a6ec5450f48717/users/4e5b4e2db2034bdd87ed19ae54371861/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.256260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb53f79cf0f440b893a6ec5450f48717, user_id=4e5b4e2db2034bdd87ed19ae54371861, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:18.259100 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:18.346198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1087/2166] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:17:18 2022] PUT /identity/v3/projects/bb53f79cf0f440b893a6ec5450f48717/users/4e5b4e2db2034bdd87ed19ae54371861/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:18.358757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07911-524d-4f6c-b6ae-bbb90c402105 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.359240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07911-524d-4f6c-b6ae-bbb90c402105 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.359414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07911-524d-4f6c-b6ae-bbb90c402105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.388095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9da07911-524d-4f6c-b6ae-bbb90c402105 None None] MFA Rules not processed for user `4e5b4e2db2034bdd87ed19ae54371861`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:18.389574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9da07911-524d-4f6c-b6ae-bbb90c402105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:18.467297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1080/2167] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:18.478864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:18.480581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:18.539559 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e9249-1d88-4a1b-8d0c-0f24363783f6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:18.543264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:18.543977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:18.544200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:18.544482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:18.553379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:18.554931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:18.565050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1088/2168] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:28.464329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:28.560078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:31.983112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9dfa9-8382-4f4f-bcdd-976e0f14ce63 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:31.983573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9dfa9-8382-4f4f-bcdd-976e0f14ce63 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:31.983667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9dfa9-8382-4f4f-bcdd-976e0f14ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:32.011497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-88b9dfa9-8382-4f4f-bcdd-976e0f14ce63 None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:32.012691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-88b9dfa9-8382-4f4f-bcdd-976e0f14ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:32.073544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1081/2169] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:32.115526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:32.116963 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:32.188196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31160515-7fa3-410a-b0b2-4a72e3a79503 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:32.193949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2f645-0ddb-4f40-b9f9-bdaf0473daf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:32.194621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f645-0ddb-4f40-b9f9-bdaf0473daf9 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:32.194911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f645-0ddb-4f40-b9f9-bdaf0473daf9 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:32.195195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f645-0ddb-4f40-b9f9-bdaf0473daf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:32.203510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2f645-0ddb-4f40-b9f9-bdaf0473daf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:32.205138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2f645-0ddb-4f40-b9f9-bdaf0473daf9 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:32.213469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1089/2170] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:17:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:17:32.943560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9dfa9-8382-4f4f-bcdd-976e0f14ce63 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:33.013970 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9dfa9-8382-4f4f-bcdd-976e0f14ce63 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:33.019234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:33.020126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:33.020416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:33.020696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] PATH_INFO: `/v3/users/4e5b4e2db2034bdd87ed19ae54371861` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:33.022495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5b4e2db2034bdd87ed19ae54371861)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:33.024521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:33.092844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3019ef-61b2-4bd5-afbe-f148072bc403 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:33.092844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3019ef-61b2-4bd5-afbe-f148072bc403 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:33.092844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3019ef-61b2-4bd5-afbe-f148072bc403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:33.110488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-dd3019ef-61b2-4bd5-afbe-f148072bc403 None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:33.111722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dd3019ef-61b2-4bd5-afbe-f148072bc403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:33.118895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1090/2171] 10.222.0.48 () {58 vars in 967 bytes} [Mon May 30 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:17:33.132821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3019ef-61b2-4bd5-afbe-f148072bc403 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:33.145373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3019ef-61b2-4bd5-afbe-f148072bc403 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:33.151171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dfd5a-8d01-49da-b503-d8f3615f9743 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:33.151845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dfd5a-8d01-49da-b503-d8f3615f9743 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:33.152132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dfd5a-8d01-49da-b503-d8f3615f9743 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:33.152411 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dfd5a-8d01-49da-b503-d8f3615f9743 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:33.164975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dfd5a-8d01-49da-b503-d8f3615f9743 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:33.166636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dfd5a-8d01-49da-b503-d8f3615f9743 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:33.176564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5b4e2db2034bdd87ed19ae54371861'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:33.177066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1091/2172] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 30 12:17:33.185302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5b4e2db2034bdd87ed19ae54371861'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:33.186124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5b4e2db2034bdd87ed19ae54371861'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:33.186804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5b4e2db2034bdd87ed19ae54371861'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:33.252663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5b4e2db2034bdd87ed19ae54371861'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:33.276465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1082/2173] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:17:32 2022] DELETE /identity/v3/users/4e5b4e2db2034bdd87ed19ae54371861 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:33.280959 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d95fb5-5795-4ce4-84b3-17b1a3aa6cea None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:33.281406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d95fb5-5795-4ce4-84b3-17b1a3aa6cea None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:33.281723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d95fb5-5795-4ce4-84b3-17b1a3aa6cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:33.301007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-94d95fb5-5795-4ce4-84b3-17b1a3aa6cea None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:33.302247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-94d95fb5-5795-4ce4-84b3-17b1a3aa6cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:33.370566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1092/2174] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:33.381060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:33.382738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:33.393719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:33.442328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364975b-9423-4bb7-a93f-3655333c1d3b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:33.447409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:33.448197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:33.448554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:33.453898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:33.476619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:33.479360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:33.489199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1083/2175] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:17:33.903317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573f22-5b88-4089-951b-9304d64a218e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:33.903710 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573f22-5b88-4089-951b-9304d64a218e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:33.904107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573f22-5b88-4089-951b-9304d64a218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:33.913314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:33.914877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:33.924396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-34573f22-5b88-4089-951b-9304d64a218e None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:33.925588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-34573f22-5b88-4089-951b-9304d64a218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:33.937906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1ad3f-83b3-4cb2-98df-2378118a106e service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:33.944265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:33.945481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:33.945775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:33.946092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] PATH_INFO: `/v3/projects/bb53f79cf0f440b893a6ec5450f48717` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:33.947336 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb53f79cf0f440b893a6ec5450f48717)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:33.949583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:33.996979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1093/2176] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:34.008834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34573f22-5b88-4089-951b-9304d64a218e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:34.010208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-34573f22-5b88-4089-951b-9304d64a218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:34.028054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:34.082985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34573f22-5b88-4089-951b-9304d64a218e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:34.084896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb53f79cf0f440b893a6ec5450f48717', 'request_id': 'req-50b4312a-1dde-4684-973d-c04854f815a1'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:34.109880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb53f79cf0f440b893a6ec5450f48717', 'request_id': 'req-50b4312a-1dde-4684-973d-c04854f815a1'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:34.156080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58054376-6255-4d73-ac74-9dfb7633c4f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:34.156819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054376-6255-4d73-ac74-9dfb7633c4f4 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.157067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054376-6255-4d73-ac74-9dfb7633c4f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.157739 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054376-6255-4d73-ac74-9dfb7633c4f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.201069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb53f79cf0f440b893a6ec5450f48717', 'request_id': 'req-50b4312a-1dde-4684-973d-c04854f815a1'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:34.214512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] The token cache is being invalidate because project bb53f79cf0f440b893a6ec5450f48717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:34.214807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:34.215682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-50b4312a-1dde-4684-973d-c04854f815a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:34.218482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1084/2177] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:17:33 2022] DELETE /identity/v3/projects/bb53f79cf0f440b893a6ec5450f48717 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:34.219893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58054376-6255-4d73-ac74-9dfb7633c4f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:34.221523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58054376-6255-4d73-ac74-9dfb7633c4f4 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:34.224480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8292-c72a-4922-95f2-2386989d040d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.224822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8292-c72a-4922-95f2-2386989d040d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.225329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8292-c72a-4922-95f2-2386989d040d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.235381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1094/2178] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 30 12:17:34.249526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-121b8292-c72a-4922-95f2-2386989d040d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:34.250989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-121b8292-c72a-4922-95f2-2386989d040d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:34.315495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1085/2179] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:34.323476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321171a9-a6d7-4954-9c3b-550576955513 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.323770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321171a9-a6d7-4954-9c3b-550576955513 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.324051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321171a9-a6d7-4954-9c3b-550576955513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.341602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-321171a9-a6d7-4954-9c3b-550576955513 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:34.342814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-321171a9-a6d7-4954-9c3b-550576955513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:34.351216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1095/2180] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:34.355410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b8292-c72a-4922-95f2-2386989d040d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:34.367404 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b8292-c72a-4922-95f2-2386989d040d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:34.372446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:34.373178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.373531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.373875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.374700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:17:34.375098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:34.376769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:34.389145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1086/2181] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:17:34.396993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321171a9-a6d7-4954-9c3b-550576955513 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:34.410947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321171a9-a6d7-4954-9c3b-550576955513 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:34.416227 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf5f69-b71b-4746-b827-bba15a10cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:34.416928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf5f69-b71b-4746-b827-bba15a10cde2 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.421897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf5f69-b71b-4746-b827-bba15a10cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.421897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf5f69-b71b-4746-b827-bba15a10cde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.421897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf5f69-b71b-4746-b827-bba15a10cde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:34.421897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf5f69-b71b-4746-b827-bba15a10cde2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:34.551482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1096/2182] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:17:34 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:17:34.555548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:34.570802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d864e-4d0c-4392-b6f7-2e4889d356bf admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:34.584872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:34.625061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be4f1-4754-4394-b615-6ce6f60911d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:34.625734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be4f1-4754-4394-b615-6ce6f60911d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.626051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be4f1-4754-4394-b615-6ce6f60911d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.626335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be4f1-4754-4394-b615-6ce6f60911d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.631931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be4f1-4754-4394-b615-6ce6f60911d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:34.631931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be4f1-4754-4394-b615-6ce6f60911d8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:34.773311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1087/2183] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:17:34 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:17:34.777599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf5f69-b71b-4746-b827-bba15a10cde2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:34.788865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf5f69-b71b-4746-b827-bba15a10cde2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:34.793834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e03ac-6438-4f53-9013-e5329d66b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:34.794822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e03ac-6438-4f53-9013-e5329d66b4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.795112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e03ac-6438-4f53-9013-e5329d66b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.796579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e03ac-6438-4f53-9013-e5329d66b4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.796579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e03ac-6438-4f53-9013-e5329d66b4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:34.797816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e03ac-6438-4f53-9013-e5329d66b4e6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:34.812060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1097/2184] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:34.813207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be4f1-4754-4394-b615-6ce6f60911d8 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:34.826879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be4f1-4754-4394-b615-6ce6f60911d8 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:34.827998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d6c8-2163-4525-b580-b1f0da1002e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:34.828666 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d6c8-2163-4525-b580-b1f0da1002e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.828963 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d6c8-2163-4525-b580-b1f0da1002e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.829238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d6c8-2163-4525-b580-b1f0da1002e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.829989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798d6c8-2163-4525-b580-b1f0da1002e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:34.831612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798d6c8-2163-4525-b580-b1f0da1002e3 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:34.841999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1088/2185] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:34.846215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e03ac-6438-4f53-9013-e5329d66b4e6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:34.857879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e03ac-6438-4f53-9013-e5329d66b4e6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:34.863206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30932de-8a58-4e82-9e8e-0740503c9893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:34.864132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30932de-8a58-4e82-9e8e-0740503c9893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.864469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30932de-8a58-4e82-9e8e-0740503c9893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.865291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30932de-8a58-4e82-9e8e-0740503c9893 admin admin] PATH_INFO: `/v3/projects/1593adad855544cd99a2131253b5519d/users/a6d925ac159a4e869ed6cad8ed8c40d5/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:34.881726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30932de-8a58-4e82-9e8e-0740503c9893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1593adad855544cd99a2131253b5519d, user_id=a6d925ac159a4e869ed6cad8ed8c40d5, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:34.884625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30932de-8a58-4e82-9e8e-0740503c9893 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:34.888174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:34.984362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1098/2186] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:17:34 2022] PUT /identity/v3/projects/1593adad855544cd99a2131253b5519d/users/a6d925ac159a4e869ed6cad8ed8c40d5/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:34.995257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf67b1f-b354-4457-bd1d-31cb750b595f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:34.995548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf67b1f-b354-4457-bd1d-31cb750b595f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:34.995831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf67b1f-b354-4457-bd1d-31cb750b595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:35.010054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7518f24-e9a4-4d24-8336-7c51c8379dd6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:35.010367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7518f24-e9a4-4d24-8336-7c51c8379dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:35.010653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7518f24-e9a4-4d24-8336-7c51c8379dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:35.014317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4bf67b1f-b354-4457-bd1d-31cb750b595f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:35.015509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4bf67b1f-b354-4457-bd1d-31cb750b595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:35.029068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c7518f24-e9a4-4d24-8336-7c51c8379dd6 None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:35.030299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c7518f24-e9a4-4d24-8336-7c51c8379dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:35.080862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1089/2187] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:35.086536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1099/2188] 10.222.0.48 () {58 vars in 967 bytes} [Mon May 30 12:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:17:35.090987 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf67b1f-b354-4457-bd1d-31cb750b595f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:35.092371 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4bf67b1f-b354-4457-bd1d-31cb750b595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:35.102522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7518f24-e9a4-4d24-8336-7c51c8379dd6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:35.103904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c7518f24-e9a4-4d24-8336-7c51c8379dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:35.152235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf67b1f-b354-4457-bd1d-31cb750b595f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:35.156091 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298aabb-1100-4215-9ee8-a9e5212e0206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:35.156744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298aabb-1100-4215-9ee8-a9e5212e0206 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:35.157083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298aabb-1100-4215-9ee8-a9e5212e0206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:35.157631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298aabb-1100-4215-9ee8-a9e5212e0206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:35.167722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298aabb-1100-4215-9ee8-a9e5212e0206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:35.169207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298aabb-1100-4215-9ee8-a9e5212e0206 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:35.172842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7518f24-e9a4-4d24-8336-7c51c8379dd6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:35.178111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:35.178826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:35.179095 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:35.179201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1090/2189] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:35.180687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:35.188057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:35.189697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:35.198156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1100/2190] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 30 12:17:36.952470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e0d8-d9d9-4561-8e5b-469690d847c3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:36.953514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e0d8-d9d9-4561-8e5b-469690d847c3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:36.953854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e0d8-d9d9-4561-8e5b-469690d847c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:36.986366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7686e0d8-d9d9-4561-8e5b-469690d847c3 None None] MFA Rules not processed for user `a6d925ac159a4e869ed6cad8ed8c40d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:36.987852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7686e0d8-d9d9-4561-8e5b-469690d847c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:37.026816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:37.059137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1091/2191] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:37.070505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:37.071909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:37.154433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7dec9-2a57-481f-8afc-afa2916f12d3 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:37.158299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:37.158948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:37.159348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:37.159488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:37.167800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:37.169279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:37.177980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1101/2192] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:38.278389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e0d8-d9d9-4561-8e5b-469690d847c3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:38.279826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7686e0d8-d9d9-4561-8e5b-469690d847c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:38.294088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686e0d8-d9d9-4561-8e5b-469690d847c3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:38.298710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:38.299396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:38.299682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:38.299959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] PATH_INFO: `/v3/users/d05466b6719b435b9a42ce3180cde8d8` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:38.301155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05466b6719b435b9a42ce3180cde8d8)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:38.303207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:38.373343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:38.374929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:38.390051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7700f4-f7f6-4f2b-add2-e404a9fe9515 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:38.394995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:38.398278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:38.398278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:38.398278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] PATH_INFO: `/v3/users/11d6334e5a5e42b1bff433aad1efaf35` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:38.398278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d6334e5a5e42b1bff433aad1efaf35)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:38.400187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:38.406376 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:38.575513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05466b6719b435b9a42ce3180cde8d8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.582432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05466b6719b435b9a42ce3180cde8d8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.583090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05466b6719b435b9a42ce3180cde8d8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.583705 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05466b6719b435b9a42ce3180cde8d8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.652937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-97882459-12a8-4fdb-ad8e-6cb6ef41fbce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05466b6719b435b9a42ce3180cde8d8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.672343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d6334e5a5e42b1bff433aad1efaf35'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.683175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1092/2193] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:17:38 2022] DELETE /identity/v3/users/d05466b6719b435b9a42ce3180cde8d8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:38.684606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d6334e5a5e42b1bff433aad1efaf35'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.688599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc771-8bb7-4437-ab5f-d155b346e46b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:38.688599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc771-8bb7-4437-ab5f-d155b346e46b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:38.688599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc771-8bb7-4437-ab5f-d155b346e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:38.711644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-140cc771-8bb7-4437-ab5f-d155b346e46b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:38.712892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-140cc771-8bb7-4437-ab5f-d155b346e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:38.780860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1093/2194] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:38.788899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d6334e5a5e42b1bff433aad1efaf35'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.791719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d6334e5a5e42b1bff433aad1efaf35'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.792372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7e99ed4b-7675-4bb5-b731-e7802796b458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d6334e5a5e42b1bff433aad1efaf35'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:38.795385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cc771-8bb7-4437-ab5f-d155b346e46b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:38.797182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-140cc771-8bb7-4437-ab5f-d155b346e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:38.814266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1102/2195] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:17:38 2022] DELETE /identity/v3/users/11d6334e5a5e42b1bff433aad1efaf35 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:17:38.857742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:38.865992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cc771-8bb7-4437-ab5f-d155b346e46b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:38.925783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:38.926466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:38.926885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:38.927067 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:38.929390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:38.951869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50b64-c0ff-43ce-9e42-d9aa5dc65c42 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:38.952164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50b64-c0ff-43ce-9e42-d9aa5dc65c42 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:38.952502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50b64-c0ff-43ce-9e42-d9aa5dc65c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:38.971504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-06b50b64-c0ff-43ce-9e42-d9aa5dc65c42 None None] MFA Rules not processed for user `a6d925ac159a4e869ed6cad8ed8c40d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:38.972815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-06b50b64-c0ff-43ce-9e42-d9aa5dc65c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:39.010644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:39.012338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:39.022441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1094/2196] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:17:39.034149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1103/2197] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:17:39.078373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:39.082690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:39.110386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65470b-f808-4e7a-b4e7-9b02872083ec service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:39.115747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:39.116754 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:39.117171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:39.117325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] PATH_INFO: `/v3/projects/f03181b981a348f4abbbe43bf50f2f61` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:39.118631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03181b981a348f4abbbe43bf50f2f61)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:39.120516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:39.259857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03181b981a348f4abbbe43bf50f2f61', 'request_id': 'req-01fa261e-b734-413f-a509-6ecd297e820c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.266883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03181b981a348f4abbbe43bf50f2f61', 'request_id': 'req-01fa261e-b734-413f-a509-6ecd297e820c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.371846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03181b981a348f4abbbe43bf50f2f61', 'request_id': 'req-01fa261e-b734-413f-a509-6ecd297e820c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.383343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] The token cache is being invalidate because project f03181b981a348f4abbbe43bf50f2f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:39.383638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.384324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.385934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1095/2198] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:17:39 2022] DELETE /identity/v3/projects/f03181b981a348f4abbbe43bf50f2f61 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:17:39.389856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b50b64-c0ff-43ce-9e42-d9aa5dc65c42 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:39.401525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b50b64-c0ff-43ce-9e42-d9aa5dc65c42 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:39.409083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:39.410513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:39.471588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:39.472614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:39.472998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:39.473375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] PATH_INFO: `/v3/users/9d5359c194914db5b0ae660284660c37` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:39.475468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5359c194914db5b0ae660284660c37)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:39.475584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:39.478728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:39.504942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa261e-b734-413f-a509-6ecd297e820c admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:39.510556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:39.511433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:39.511765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:39.512054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] PATH_INFO: `/v3/projects/2f91b658c5884f5eb922acf79c1b9324` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:39.516351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f91b658c5884f5eb922acf79c1b9324)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:39.516351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:39.735153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:39.748071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f91b658c5884f5eb922acf79c1b9324', 'request_id': 'req-162ffdd2-622d-4203-b4ed-48f456bae458'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.748866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5359c194914db5b0ae660284660c37'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.755052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f91b658c5884f5eb922acf79c1b9324', 'request_id': 'req-162ffdd2-622d-4203-b4ed-48f456bae458'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.756669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5359c194914db5b0ae660284660c37'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.830239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f91b658c5884f5eb922acf79c1b9324', 'request_id': 'req-162ffdd2-622d-4203-b4ed-48f456bae458'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.841884 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] The token cache is being invalidate because project 2f91b658c5884f5eb922acf79c1b9324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:39.842665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.842874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.844478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1096/2199] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:17:39 2022] DELETE /identity/v3/projects/2f91b658c5884f5eb922acf79c1b9324 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:17:39.958820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5359c194914db5b0ae660284660c37'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.960113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5359c194914db5b0ae660284660c37'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.960949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-854539cc-f692-42a0-9c08-7d01d40173d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5359c194914db5b0ae660284660c37'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:39.982260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1104/2200] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:17:39 2022] DELETE /identity/v3/users/9d5359c194914db5b0ae660284660c37 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:40.236881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:40.238589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:40.312516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ffdd2-622d-4203-b4ed-48f456bae458 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:40.369618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:40.370497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:40.370811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:40.371093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] PATH_INFO: `/v3/projects/c3cb75725671472ab2a39207bfe1497f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:40.372269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cb75725671472ab2a39207bfe1497f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:40.374239 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:40.391899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:40.486539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cb75725671472ab2a39207bfe1497f', 'request_id': 'req-574454c9-bdd4-4ff0-81ba-a28f8eada229'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:40.493272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cb75725671472ab2a39207bfe1497f', 'request_id': 'req-574454c9-bdd4-4ff0-81ba-a28f8eada229'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:40.618323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cb75725671472ab2a39207bfe1497f', 'request_id': 'req-574454c9-bdd4-4ff0-81ba-a28f8eada229'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:40.630443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] The token cache is being invalidate because project c3cb75725671472ab2a39207bfe1497f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:40.630736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:40.631388 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-574454c9-bdd4-4ff0-81ba-a28f8eada229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:40.633836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1097/2201] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:17:40 2022] DELETE /identity/v3/projects/c3cb75725671472ab2a39207bfe1497f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:40.639923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321f636-b5ff-4c75-a7cf-c4e014881b30 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:40.640757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321f636-b5ff-4c75-a7cf-c4e014881b30 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:40.641251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321f636-b5ff-4c75-a7cf-c4e014881b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:40.661443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f321f636-b5ff-4c75-a7cf-c4e014881b30 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:40.662674 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f321f636-b5ff-4c75-a7cf-c4e014881b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:40.729225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1105/2202] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:40.736673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeed23b-6c60-4388-a068-52c7b6f5dad3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:40.736969 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeed23b-6c60-4388-a068-52c7b6f5dad3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:40.737256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeed23b-6c60-4388-a068-52c7b6f5dad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:40.757005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-cfeed23b-6c60-4388-a068-52c7b6f5dad3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:40.758259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cfeed23b-6c60-4388-a068-52c7b6f5dad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:40.766555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1098/2203] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:40.770772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321f636-b5ff-4c75-a7cf-c4e014881b30 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:40.780898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321f636-b5ff-4c75-a7cf-c4e014881b30 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:40.786146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:40.786802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:40.787091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:40.787373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:40.788665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:17:40.788979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:40.790641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:40.802379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1106/2204] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:17:40.810377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeed23b-6c60-4388-a068-52c7b6f5dad3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:40.820008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeed23b-6c60-4388-a068-52c7b6f5dad3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:40.824759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a65be5-2494-42bf-b628-b7a60cd8f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:40.825409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a65be5-2494-42bf-b628-b7a60cd8f536 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:40.825698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a65be5-2494-42bf-b628-b7a60cd8f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:40.826008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a65be5-2494-42bf-b628-b7a60cd8f536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:40.826720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a65be5-2494-42bf-b628-b7a60cd8f536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:40.828917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a65be5-2494-42bf-b628-b7a60cd8f536 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:40.963507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1099/2205] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:17:40 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:17:40.970834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:40.980793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df960668-e69a-4bcc-9763-6cc2360ca693 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:41.038343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a84b28-39fd-41ab-9e27-bb4e1f94d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:41.039022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84b28-39fd-41ab-9e27-bb4e1f94d589 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:41.039902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84b28-39fd-41ab-9e27-bb4e1f94d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:41.039902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84b28-39fd-41ab-9e27-bb4e1f94d589 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:41.040291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a84b28-39fd-41ab-9e27-bb4e1f94d589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:41.042363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a84b28-39fd-41ab-9e27-bb4e1f94d589 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:41.173323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1107/2206] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:17:40 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:17:41.177073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a65be5-2494-42bf-b628-b7a60cd8f536 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:41.188251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a65be5-2494-42bf-b628-b7a60cd8f536 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:41.193030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f4dc-45e4-473f-82fc-8a972aee37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:41.193730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f4dc-45e4-473f-82fc-8a972aee37c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:41.194049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f4dc-45e4-473f-82fc-8a972aee37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:41.194985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1f4dc-45e4-473f-82fc-8a972aee37c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:41.195713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1f4dc-45e4-473f-82fc-8a972aee37c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:41.197319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1f4dc-45e4-473f-82fc-8a972aee37c8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:41.207834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1100/2207] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:17:41.215914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a84b28-39fd-41ab-9e27-bb4e1f94d589 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:41.225945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a84b28-39fd-41ab-9e27-bb4e1f94d589 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:41.230840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc8838-c1f0-4a03-b089-3be27bd87da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:41.231492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc8838-c1f0-4a03-b089-3be27bd87da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:41.231776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc8838-c1f0-4a03-b089-3be27bd87da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:41.232055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc8838-c1f0-4a03-b089-3be27bd87da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:41.232784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc8838-c1f0-4a03-b089-3be27bd87da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:41.234458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc8838-c1f0-4a03-b089-3be27bd87da4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:41.245138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1108/2208] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:17:41.256375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f4dc-45e4-473f-82fc-8a972aee37c8 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:41.267021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1f4dc-45e4-473f-82fc-8a972aee37c8 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:41.271870 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:41.272842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:41.273130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:41.273413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] PATH_INFO: `/v3/projects/4956bff41cee45f7a113483b6a98db7b/users/9daa314e392144d49b4c48070d659ae7/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:41.289446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4956bff41cee45f7a113483b6a98db7b, user_id=9daa314e392144d49b4c48070d659ae7, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:41.292164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:41.391143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1101/2209] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:17:41 2022] PUT /identity/v3/projects/4956bff41cee45f7a113483b6a98db7b/users/9daa314e392144d49b4c48070d659ae7/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:41.401745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99441-4191-409b-94f3-2d137df5db10 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:41.402150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99441-4191-409b-94f3-2d137df5db10 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:41.402508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99441-4191-409b-94f3-2d137df5db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:41.430722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-76f99441-4191-409b-94f3-2d137df5db10 None None] MFA Rules not processed for user `9daa314e392144d49b4c48070d659ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:41.432032 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-76f99441-4191-409b-94f3-2d137df5db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:41.437053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:41.496734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1109/2210] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:41.507984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:41.509679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:41.575618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85364b7-f3db-4872-92d2-644d34f98403 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:41.579589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfd642-59f4-45a5-984c-56d935626ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:41.580269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd642-59f4-45a5-984c-56d935626ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:41.580555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd642-59f4-45a5-984c-56d935626ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:41.580831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd642-59f4-45a5-984c-56d935626ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:41.589291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfd642-59f4-45a5-984c-56d935626ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:41.590792 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfd642-59f4-45a5-984c-56d935626ba6 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:41.599421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1102/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:41.620785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99441-4191-409b-94f3-2d137df5db10 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:41.685538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99441-4191-409b-94f3-2d137df5db10 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:41.690369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:41.691326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:41.691615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:41.691896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] PATH_INFO: `/v3/users/9daa314e392144d49b4c48070d659ae7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:41.693118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9daa314e392144d49b4c48070d659ae7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:41.695467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:41.906406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9daa314e392144d49b4c48070d659ae7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:41.915583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9daa314e392144d49b4c48070d659ae7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:42.007395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9daa314e392144d49b4c48070d659ae7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:42.008196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9daa314e392144d49b4c48070d659ae7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:42.008873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9daa314e392144d49b4c48070d659ae7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:42.031404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1110/2212] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:17:41 2022] DELETE /identity/v3/users/9daa314e392144d49b4c48070d659ae7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:42.033944 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b01488-0290-4904-a992-87345a873b44 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:42.034447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b01488-0290-4904-a992-87345a873b44 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:42.034734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b01488-0290-4904-a992-87345a873b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:42.052591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-48b01488-0290-4904-a992-87345a873b44 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:42.053836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-48b01488-0290-4904-a992-87345a873b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:42.091967 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:42.112832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1103/2213] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:17:42.123329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:42.124849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:42.154339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:42.184390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e1bd2-1b97-4951-b884-9461b8e49ee7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:42.188451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324453e-244b-412f-957b-0490f50615fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:42.189208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324453e-244b-412f-957b-0490f50615fb service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:42.189500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324453e-244b-412f-957b-0490f50615fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:42.189781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324453e-244b-412f-957b-0490f50615fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:42.202967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324453e-244b-412f-957b-0490f50615fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:42.202967 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324453e-244b-412f-957b-0490f50615fb service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:42.212240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1111/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:17:42.880258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b01488-0290-4904-a992-87345a873b44 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:17:42.882549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-48b01488-0290-4904-a992-87345a873b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:42.896654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b01488-0290-4904-a992-87345a873b44 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:17:42.904086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:17:42.905395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:42.905791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:42.906429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] PATH_INFO: `/v3/projects/4956bff41cee45f7a113483b6a98db7b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:42.909066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4956bff41cee45f7a113483b6a98db7b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:17:42.911673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:17:43.042321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4956bff41cee45f7a113483b6a98db7b', 'request_id': 'req-bcfe602d-c66b-4320-b34c-4600e4b43f35'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:43.048896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4956bff41cee45f7a113483b6a98db7b', 'request_id': 'req-bcfe602d-c66b-4320-b34c-4600e4b43f35'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:43.131798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4956bff41cee45f7a113483b6a98db7b', 'request_id': 'req-bcfe602d-c66b-4320-b34c-4600e4b43f35'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:43.147458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] The token cache is being invalidate because project 4956bff41cee45f7a113483b6a98db7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:17:43.148526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:43.149727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bcfe602d-c66b-4320-b34c-4600e4b43f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:17:43.152675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1104/2215] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:17:42 2022] DELETE /identity/v3/projects/4956bff41cee45f7a113483b6a98db7b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:17:43.522213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4b3b-0e86-4daa-b0d0-c456b917a019 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:17:43.523236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4b3b-0e86-4daa-b0d0-c456b917a019 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:17:43.523331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4b3b-0e86-4daa-b0d0-c456b917a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:17:43.541355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-afac4b3b-0e86-4daa-b0d0-c456b917a019 None None] MFA Rules not processed for user `00e99aa4e6c14e7bafa57df2c867e9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:17:43.542600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-afac4b3b-0e86-4daa-b0d0-c456b917a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:17:43.601268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1112/2216] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:17:53.143356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:53.593650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=40 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:26.267355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704706-82ac-48a8-a4d2-81d1919b71e8 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:26.267930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704706-82ac-48a8-a4d2-81d1919b71e8 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:26.268034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704706-82ac-48a8-a4d2-81d1919b71e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:26.288223 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d6704706-82ac-48a8-a4d2-81d1919b71e8 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:18:26.289519 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d6704706-82ac-48a8-a4d2-81d1919b71e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:26.348319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1105/2217] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:18:26.373829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4b3b-0e86-4daa-b0d0-c456b917a019 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:26.375502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-afac4b3b-0e86-4daa-b0d0-c456b917a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:26.477399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4b3b-0e86-4daa-b0d0-c456b917a019 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:26.483108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98859ea-9998-4243-b91e-dbdc14c6fb7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:26.483796 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98859ea-9998-4243-b91e-dbdc14c6fb7a service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:26.484117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98859ea-9998-4243-b91e-dbdc14c6fb7a service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:26.484398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98859ea-9998-4243-b91e-dbdc14c6fb7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:26.493079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98859ea-9998-4243-b91e-dbdc14c6fb7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:26.494849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98859ea-9998-4243-b91e-dbdc14c6fb7a service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:26.505298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1113/2218] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:18:30.149563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891ae10-0355-4e58-8838-fe050240f0fa None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:30.150061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891ae10-0355-4e58-8838-fe050240f0fa None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:30.150268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891ae10-0355-4e58-8838-fe050240f0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:30.168443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4891ae10-0355-4e58-8838-fe050240f0fa None None] MFA Rules not processed for user `8d419d0520ed48b181dc528aff6364fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:18:30.169642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4891ae10-0355-4e58-8838-fe050240f0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:30.228497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1106/2219] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:18:31.589231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170eea1-e3b7-45af-acbd-1309ce4ff5ed None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:31.589661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170eea1-e3b7-45af-acbd-1309ce4ff5ed None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:31.589797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170eea1-e3b7-45af-acbd-1309ce4ff5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:31.608117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1170eea1-e3b7-45af-acbd-1309ce4ff5ed None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:18:31.609304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1170eea1-e3b7-45af-acbd-1309ce4ff5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:31.617433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1114/2220] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:18:31.661457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891ae10-0355-4e58-8838-fe050240f0fa None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:31.673897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891ae10-0355-4e58-8838-fe050240f0fa None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:31.679376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1251e-0f87-44ad-bc39-ec5c1360e011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:31.680084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1251e-0f87-44ad-bc39-ec5c1360e011 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:31.680375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1251e-0f87-44ad-bc39-ec5c1360e011 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:31.680655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1251e-0f87-44ad-bc39-ec5c1360e011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:31.688775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1251e-0f87-44ad-bc39-ec5c1360e011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:31.690465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1251e-0f87-44ad-bc39-ec5c1360e011 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:31.699924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1107/2221] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:18:33.182683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170eea1-e3b7-45af-acbd-1309ce4ff5ed None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:33.185722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1170eea1-e3b7-45af-acbd-1309ce4ff5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:33.282525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170eea1-e3b7-45af-acbd-1309ce4ff5ed None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:33.287704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:33.288390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:33.288672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:33.288952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:33.290671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:33.301784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:33.303423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:33.313102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1115/2222] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:18:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:18:36.110129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412be695-044b-4f36-b156-88c9facf4975 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:36.110983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412be695-044b-4f36-b156-88c9facf4975 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:36.111477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412be695-044b-4f36-b156-88c9facf4975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:36.130506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-412be695-044b-4f36-b156-88c9facf4975 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:18:36.131750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-412be695-044b-4f36-b156-88c9facf4975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:36.139859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1108/2223] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:18:36.161902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:36.175410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c660-2454-406b-a8c0-7c2b4b76bd6f service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:36.181502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:36.182260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:36.182641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:36.182997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:36.192716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:36.194432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:36.204469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1116/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:18:40.976273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1000-0c8c-4a12-a184-5310e6949795 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:40.976741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1000-0c8c-4a12-a184-5310e6949795 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:40.976865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1000-0c8c-4a12-a184-5310e6949795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:40.995459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b4ff1000-0c8c-4a12-a184-5310e6949795 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:18:40.996843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b4ff1000-0c8c-4a12-a184-5310e6949795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:41.006036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1109/2225] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:18:41.033785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:41.035234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:41.051328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a56ada-9ba4-4e6d-8a5e-6ed9d185f1cf service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:41.057026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:41.057662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:41.057949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:41.058251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:41.066660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:41.068241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:41.077925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1117/2226] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:18:46.579332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136363-05bf-4003-8b93-e5832275a0fa None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:46.579785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136363-05bf-4003-8b93-e5832275a0fa None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:46.579930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136363-05bf-4003-8b93-e5832275a0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:46.630617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0b136363-05bf-4003-8b93-e5832275a0fa None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:18:46.631866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0b136363-05bf-4003-8b93-e5832275a0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:46.683041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:46.700750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1110/2227] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:18:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:18:46.828530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:46.830056 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:46.833933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:18:46.921449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd83fb5-9c20-4419-b7ef-c28d5a28430b service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:46.926495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc99c7-3725-4c77-a3ac-7654dee27010 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:46.927158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc99c7-3725-4c77-a3ac-7654dee27010 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:46.927444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc99c7-3725-4c77-a3ac-7654dee27010 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:46.927721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc99c7-3725-4c77-a3ac-7654dee27010 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:46.936992 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc99c7-3725-4c77-a3ac-7654dee27010 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:46.938726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc99c7-3725-4c77-a3ac-7654dee27010 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:46.947536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1118/2228] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:18:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:18:50.408761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905974-036d-4db6-8b5d-c1dc42dc3395 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:50.409377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905974-036d-4db6-8b5d-c1dc42dc3395 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:50.409573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905974-036d-4db6-8b5d-c1dc42dc3395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:50.429215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d2905974-036d-4db6-8b5d-c1dc42dc3395 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:18:50.433516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d2905974-036d-4db6-8b5d-c1dc42dc3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:50.438807 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1111/2229] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:18:50.463295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc99c7-3725-4c77-a3ac-7654dee27010 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:50.482875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc99c7-3725-4c77-a3ac-7654dee27010 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:50.489238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9a4a-e59f-40f4-a914-7a6d30a13546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:50.489895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9a4a-e59f-40f4-a914-7a6d30a13546 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:50.490730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9a4a-e59f-40f4-a914-7a6d30a13546 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:50.490730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9a4a-e59f-40f4-a914-7a6d30a13546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:50.506119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b9a4a-e59f-40f4-a914-7a6d30a13546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:50.507866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b9a4a-e59f-40f4-a914-7a6d30a13546 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:50.519700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1119/2230] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:18:55.733614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f30c4-e1ea-4d0a-a917-b313813b55b4 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:55.735384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f30c4-e1ea-4d0a-a917-b313813b55b4 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:55.736374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f30c4-e1ea-4d0a-a917-b313813b55b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:55.769626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d79f30c4-e1ea-4d0a-a917-b313813b55b4 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:18:55.770888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d79f30c4-e1ea-4d0a-a917-b313813b55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:18:55.782668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1112/2231] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:18:55.814802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9a4a-e59f-40f4-a914-7a6d30a13546 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:18:55.829910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9a4a-e59f-40f4-a914-7a6d30a13546 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:18:55.837715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe07c5a-9ac9-4fff-bbf6-c3755c93a4fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:18:55.838632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07c5a-9ac9-4fff-bbf6-c3755c93a4fc service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:18:55.839080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07c5a-9ac9-4fff-bbf6-c3755c93a4fc service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:18:55.839516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07c5a-9ac9-4fff-bbf6-c3755c93a4fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:18:55.864960 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe07c5a-9ac9-4fff-bbf6-c3755c93a4fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:18:55.866931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe07c5a-9ac9-4fff-bbf6-c3755c93a4fc service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:18:55.881165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1120/2232] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:05.683218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30428-fb37-44e2-9b90-0bc353ceba75 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:05.683784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30428-fb37-44e2-9b90-0bc353ceba75 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:05.683784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30428-fb37-44e2-9b90-0bc353ceba75 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:05.685680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1113/2233] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:19:05.691507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3a62-bc15-4970-8987-8e60ef2357b0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:05.691998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3a62-bc15-4970-8987-8e60ef2357b0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:05.692096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3a62-bc15-4970-8987-8e60ef2357b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:05.729198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c0af3a62-bc15-4970-8987-8e60ef2357b0 None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:05.730618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c0af3a62-bc15-4970-8987-8e60ef2357b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:05.740556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1121/2234] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:19:05.757039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af30428-fb37-44e2-9b90-0bc353ceba75 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:05.758905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6af30428-fb37-44e2-9b90-0bc353ceba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:05.836589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af30428-fb37-44e2-9b90-0bc353ceba75 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:05.840039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b32b61-1f89-4055-a9b1-677ef07c9a55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca08d82f02a24e0088aceff2b6ba307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:05.840675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b32b61-1f89-4055-a9b1-677ef07c9a55 service glance] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:05.840958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b32b61-1f89-4055-a9b1-677ef07c9a55 service glance] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:05.841272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b32b61-1f89-4055-a9b1-677ef07c9a55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:05.851178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b32b61-1f89-4055-a9b1-677ef07c9a55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:05.852605 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b32b61-1f89-4055-a9b1-677ef07c9a55 service glance] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:05.862951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1114/2235] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:06.043370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcacc34-4fe0-4d7c-a4f1-c9ea2c3ea49e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:06.043713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcacc34-4fe0-4d7c-a4f1-c9ea2c3ea49e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:06.043950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcacc34-4fe0-4d7c-a4f1-c9ea2c3ea49e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:06.046088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1122/2236] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:19:06.050926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8e1f-b985-4cae-a9b1-e840bd10b623 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:06.051225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8e1f-b985-4cae-a9b1-e840bd10b623 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:06.051514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8e1f-b985-4cae-a9b1-e840bd10b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:06.074377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-aacb8e1f-b985-4cae-a9b1-e840bd10b623 None None] MFA Rules not processed for user `35763651d4614bf68400b5efce4113a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:06.074377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-aacb8e1f-b985-4cae-a9b1-e840bd10b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:06.126889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1115/2237] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:19:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:19:06.138717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcacc34-4fe0-4d7c-a4f1-c9ea2c3ea49e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:06.140456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8fcacc34-4fe0-4d7c-a4f1-c9ea2c3ea49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:06.154183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcacc34-4fe0-4d7c-a4f1-c9ea2c3ea49e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:06.158495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a2c6-0ace-42dd-bea5-6d1bfdd09b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:06.159146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a2c6-0ace-42dd-bea5-6d1bfdd09b56 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:06.159435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a2c6-0ace-42dd-bea5-6d1bfdd09b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:06.159714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a2c6-0ace-42dd-bea5-6d1bfdd09b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:06.167380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a2c6-0ace-42dd-bea5-6d1bfdd09b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:06.168846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a2c6-0ace-42dd-bea5-6d1bfdd09b56 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:06.177491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1123/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:19:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:06.263697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b7ec6-b818-4288-94f9-66517b63ebe1 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:06.263994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b7ec6-b818-4288-94f9-66517b63ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:06.264282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b7ec6-b818-4288-94f9-66517b63ebe1 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:06.265676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1116/2239] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:19:06.271279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267508ea-7cab-4f01-a3c3-344e65bca0fd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:06.271599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267508ea-7cab-4f01-a3c3-344e65bca0fd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:06.271881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267508ea-7cab-4f01-a3c3-344e65bca0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:06.290291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-267508ea-7cab-4f01-a3c3-344e65bca0fd None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:06.291505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-267508ea-7cab-4f01-a3c3-344e65bca0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:06.301527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1124/2240] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:19:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:19:06.312183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b7ec6-b818-4288-94f9-66517b63ebe1 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:06.323103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b7ec6-b818-4288-94f9-66517b63ebe1 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:06.326766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffe42d-3df7-4419-96d0-43582e11bc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:06.327448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffe42d-3df7-4419-96d0-43582e11bc2b service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:06.327765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffe42d-3df7-4419-96d0-43582e11bc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:06.328049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffe42d-3df7-4419-96d0-43582e11bc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:06.338095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffe42d-3df7-4419-96d0-43582e11bc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:06.344096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffe42d-3df7-4419-96d0-43582e11bc2b service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:06.350360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1117/2241] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:19:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:12.139562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6f716-77f1-4094-a853-eefe6dbeb72f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:12.140014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6f716-77f1-4094-a853-eefe6dbeb72f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:12.140126 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6f716-77f1-4094-a853-eefe6dbeb72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:12.157561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4cc6f716-77f1-4094-a853-eefe6dbeb72f None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:12.159039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4cc6f716-77f1-4094-a853-eefe6dbeb72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:12.166993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1125/2242] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:19:12.179182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffe42d-3df7-4419-96d0-43582e11bc2b service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:12.190839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffe42d-3df7-4419-96d0-43582e11bc2b service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:12.195812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4130b3-1492-47e2-9356-429642c791cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:12.196445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4130b3-1492-47e2-9356-429642c791cd service swift] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:12.196731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4130b3-1492-47e2-9356-429642c791cd service swift] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:12.197010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4130b3-1492-47e2-9356-429642c791cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:12.205052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4130b3-1492-47e2-9356-429642c791cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:12.206672 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4130b3-1492-47e2-9356-429642c791cd service swift] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:12.214650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1118/2243] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:19:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:19:17.175877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87498-8eec-4a11-bed3-a787d4eba6d5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:17.176445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87498-8eec-4a11-bed3-a787d4eba6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:17.176445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87498-8eec-4a11-bed3-a787d4eba6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:17.182231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=74 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:17.196178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c8c87498-8eec-4a11-bed3-a787d4eba6d5 None None] MFA Rules not processed for user `a6d925ac159a4e869ed6cad8ed8c40d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:17.197383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c8c87498-8eec-4a11-bed3-a787d4eba6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:17.255626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1126/2244] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:19:22.211645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=80 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:27.248562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=24 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:35.946303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7bb36-a286-486a-861b-e38c5c2db56a None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:35.947335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7bb36-a286-486a-861b-e38c5c2db56a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:35.948011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7bb36-a286-486a-861b-e38c5c2db56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:35.966755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-07b7bb36-a286-486a-861b-e38c5c2db56a None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:35.967977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-07b7bb36-a286-486a-861b-e38c5c2db56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:35.980153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1119/2245] 10.222.0.48 () {58 vars in 967 bytes} [Mon May 30 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:19:35.989031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c87498-8eec-4a11-bed3-a787d4eba6d5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:36.001346 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c87498-8eec-4a11-bed3-a787d4eba6d5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:36.006603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5336-cde1-47d5-9453-821fc71e80ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:36.007247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5336-cde1-47d5-9453-821fc71e80ba service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:36.007534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5336-cde1-47d5-9453-821fc71e80ba service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:36.007812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5336-cde1-47d5-9453-821fc71e80ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:36.016029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d5336-cde1-47d5-9453-821fc71e80ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:36.017662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d5336-cde1-47d5-9453-821fc71e80ba service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:36.025723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1127/2246] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:19:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:19:45.960909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:46.022455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:49.101507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d648a-5e42-4cf6-bb76-b151b5f09114 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:49.102062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d648a-5e42-4cf6-bb76-b151b5f09114 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:49.102160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d648a-5e42-4cf6-bb76-b151b5f09114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:49.122262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4f7d648a-5e42-4cf6-bb76-b151b5f09114 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:49.123504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4f7d648a-5e42-4cf6-bb76-b151b5f09114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:49.131352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1120/2247] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:19:49.158892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5336-cde1-47d5-9453-821fc71e80ba service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:49.170574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5336-cde1-47d5-9453-821fc71e80ba service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:49.176650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1c3ad-d2c4-4591-ac11-4a989e445780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:49.177280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1c3ad-d2c4-4591-ac11-4a989e445780 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:49.177568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1c3ad-d2c4-4591-ac11-4a989e445780 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:49.177845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1c3ad-d2c4-4591-ac11-4a989e445780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:49.185979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1c3ad-d2c4-4591-ac11-4a989e445780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:49.187617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1c3ad-d2c4-4591-ac11-4a989e445780 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:49.196811 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1128/2248] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:19:54.568583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4cf6e-fae0-4453-a073-694cdc654a31 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:54.569183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4cf6e-fae0-4453-a073-694cdc654a31 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:54.569183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4cf6e-fae0-4453-a073-694cdc654a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:54.591230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-b4c4cf6e-fae0-4453-a073-694cdc654a31 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:54.597770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b4c4cf6e-fae0-4453-a073-694cdc654a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:54.601714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1121/2249] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:19:54.625530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1c3ad-d2c4-4591-ac11-4a989e445780 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:54.644076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1c3ad-d2c4-4591-ac11-4a989e445780 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:54.645809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa765a2-f286-45ff-87d3-0995c58222e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:54.646682 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa765a2-f286-45ff-87d3-0995c58222e1 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:54.647152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa765a2-f286-45ff-87d3-0995c58222e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:54.647596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa765a2-f286-45ff-87d3-0995c58222e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:54.661917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa765a2-f286-45ff-87d3-0995c58222e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:54.661917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa765a2-f286-45ff-87d3-0995c58222e1 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:54.669810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1129/2250] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:19:58.393326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400d57f-ce7f-4eb2-a6ab-8011c4462e23 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:58.393862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400d57f-ce7f-4eb2-a6ab-8011c4462e23 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:58.393994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400d57f-ce7f-4eb2-a6ab-8011c4462e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:58.411976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9400d57f-ce7f-4eb2-a6ab-8011c4462e23 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:19:58.413149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9400d57f-ce7f-4eb2-a6ab-8011c4462e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:19:58.420784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1122/2251] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:19:58.446514 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa765a2-f286-45ff-87d3-0995c58222e1 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:19:58.458012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa765a2-f286-45ff-87d3-0995c58222e1 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:19:58.463764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45379438-7038-43d8-965a-bafac30d396f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:19:58.464657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379438-7038-43d8-965a-bafac30d396f service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:19:58.464954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379438-7038-43d8-965a-bafac30d396f service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:19:58.465238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379438-7038-43d8-965a-bafac30d396f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:19:58.474917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45379438-7038-43d8-965a-bafac30d396f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:19:58.476576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45379438-7038-43d8-965a-bafac30d396f service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:19:58.487161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1130/2252] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:02.690219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6430f-008c-47e9-99df-98edf9c99716 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:02.690742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6430f-008c-47e9-99df-98edf9c99716 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:02.690865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6430f-008c-47e9-99df-98edf9c99716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:02.709189 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f1c6430f-008c-47e9-99df-98edf9c99716 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:20:02.710344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f1c6430f-008c-47e9-99df-98edf9c99716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:02.718105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1123/2253] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:20:02.745526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45379438-7038-43d8-965a-bafac30d396f service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:02.757363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45379438-7038-43d8-965a-bafac30d396f service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:02.763104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1b5d-dfd0-4e5e-b943-f0bb3262a605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:02.763840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1b5d-dfd0-4e5e-b943-f0bb3262a605 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:02.764197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1b5d-dfd0-4e5e-b943-f0bb3262a605 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:02.764547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1b5d-dfd0-4e5e-b943-f0bb3262a605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:02.774189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa1b5d-dfd0-4e5e-b943-f0bb3262a605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:02.775849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa1b5d-dfd0-4e5e-b943-f0bb3262a605 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:02.786288 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1131/2254] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:08.014510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516af4-67bb-4b9e-ae1c-3977b893b161 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:08.014974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516af4-67bb-4b9e-ae1c-3977b893b161 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:08.015107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516af4-67bb-4b9e-ae1c-3977b893b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:08.033709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-1c516af4-67bb-4b9e-ae1c-3977b893b161 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:20:08.034952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1c516af4-67bb-4b9e-ae1c-3977b893b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:08.043534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1124/2255] 10.222.0.39 () {58 vars in 1016 bytes} [Mon May 30 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:20:08.086695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1b5d-dfd0-4e5e-b943-f0bb3262a605 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:08.097858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1b5d-dfd0-4e5e-b943-f0bb3262a605 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:08.103238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:08.103868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:08.104177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:08.104448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:08.112522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:08.114624 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:08.123886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1132/2256] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:14.082584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4aab7-d2d8-43f6-b91e-f36696a65949 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:14.083077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4aab7-d2d8-43f6-b91e-f36696a65949 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:14.083178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4aab7-d2d8-43f6-b91e-f36696a65949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:14.100800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-33f4aab7-d2d8-43f6-b91e-f36696a65949 None None] MFA Rules not processed for user `00e99aa4e6c14e7bafa57df2c867e9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:20:14.102038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-33f4aab7-d2d8-43f6-b91e-f36696a65949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:14.108900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1125/2257] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:20:18.119726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=30 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:20:22.088909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:22.090488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:22.102422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4a60-c41a-4635-b929-ff42b44b5a95 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:22.106654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d8f06-a454-437f-a826-d4680b5da45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:22.107328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8f06-a454-437f-a826-d4680b5da45b service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:22.107640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8f06-a454-437f-a826-d4680b5da45b service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:22.107917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8f06-a454-437f-a826-d4680b5da45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:22.109713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7d8d8f06-a454-437f-a826-d4680b5da45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:22.123795 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d8f06-a454-437f-a826-d4680b5da45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:22.125226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d8f06-a454-437f-a826-d4680b5da45b service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:22.137328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1133/2258] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:23.893630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4aab7-d2d8-43f6-b91e-f36696a65949 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:23.898327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=19 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:20:23.903565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4aab7-d2d8-43f6-b91e-f36696a65949 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:23.907106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:23.907741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:23.908320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:23.908598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:23.910385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:23.923888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:23.925314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:23.936585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1126/2259] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:32.132024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:20:33.938976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:20:43.395755 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934820c-a784-4923-a418-1fa09957d3e6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:43.396223 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934820c-a784-4923-a418-1fa09957d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:43.396338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934820c-a784-4923-a418-1fa09957d3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:43.414731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a934820c-a784-4923-a418-1fa09957d3e6 None None] MFA Rules not processed for user `8d419d0520ed48b181dc528aff6364fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:20:43.416045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a934820c-a784-4923-a418-1fa09957d3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:43.423021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1134/2260] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:20:43.725753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:43.735171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74b6f9-06ef-466e-aaf9-1b4be234202d service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:43.739061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:43.739879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:43.740164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:43.740439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:43.742836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:43.753123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:43.754688 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:43.763815 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1127/2261] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:44.122476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934820c-a784-4923-a418-1fa09957d3e6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:44.135135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934820c-a784-4923-a418-1fa09957d3e6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:44.140997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:44.141657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:44.141943 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:44.142241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:44.144142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:44.155948 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:44.158875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:44.169215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1135/2262] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:45.187099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:45.200723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07473f-4b40-4d7a-afb4-b258096c47f3 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:45.206240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:45.206874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:45.207158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:45.207432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:45.209142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:45.219630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:45.221142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:45.230194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1128/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:20:47.086357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:47.110867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84ed9-a6e5-4f63-9348-fb4119d22418 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:47.116666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:47.117427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:47.118335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:47.118539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:47.120566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:47.188422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:47.193517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:47.200508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1136/2264] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:47.244064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:47.261881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ec8d-e33f-47ef-bd34-806fb8a37c3f service nova] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:47.266051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:47.270118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:47.270118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:47.270118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:47.270118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:47.279507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:47.280999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:47.290178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1129/2265] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:48.220769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:48.232036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471663fd-04a0-4f96-9e5f-64430ec7ae90 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:48.238279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:48.239212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:48.240354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:48.240806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:48.243219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:48.256356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:48.258067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:48.270057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1137/2266] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:53.366721 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:53.379521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c53f5-0335-4629-9b2e-ea971ad9bb60 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:53.386095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:53.386993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:53.387440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:53.387883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:53.389820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:53.411989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:53.413601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:53.424243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1130/2267] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:20:53.494964 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:53.496489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:53.512525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84102b-6f16-42e3-a8a8-c90609010504 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:53.517545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:53.518512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:53.518799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:53.519076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] PATH_INFO: `/v3/users/a6d925ac159a4e869ed6cad8ed8c40d5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:53.520279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d925ac159a4e869ed6cad8ed8c40d5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:53.522294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:53.739070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d925ac159a4e869ed6cad8ed8c40d5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:53.746609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d925ac159a4e869ed6cad8ed8c40d5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:53.823482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d925ac159a4e869ed6cad8ed8c40d5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:53.824101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d925ac159a4e869ed6cad8ed8c40d5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:53.824722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2ae57a39-491b-40c5-b80e-f10829c6a192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d925ac159a4e869ed6cad8ed8c40d5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:53.842480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1138/2268] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:20:53 2022] DELETE /identity/v3/users/a6d925ac159a4e869ed6cad8ed8c40d5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:20:54.099580 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:54.111076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9675d9-b60b-4fe2-acd1-337745100587 service placement] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:54.194627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:54.207538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:54.207538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:54.207538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] PATH_INFO: `/v3/projects/1593adad855544cd99a2131253b5519d` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:54.207538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1593adad855544cd99a2131253b5519d)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:54.207538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:54.363675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1593adad855544cd99a2131253b5519d', 'request_id': 'req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:54.370798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1593adad855544cd99a2131253b5519d', 'request_id': 'req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:54.465279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1593adad855544cd99a2131253b5519d', 'request_id': 'req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:54.476299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] The token cache is being invalidate because project 1593adad855544cd99a2131253b5519d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:20:54.476590 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:54.477215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cee8628a-8c1d-482a-b62f-524bb0dbb2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:20:54.479282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1131/2269] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:20:54 2022] DELETE /identity/v3/projects/1593adad855544cd99a2131253b5519d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:20:54.484449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd937f7-2f14-4593-bdce-ba2e96d8d22a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:54.484749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd937f7-2f14-4593-bdce-ba2e96d8d22a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:54.485036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd937f7-2f14-4593-bdce-ba2e96d8d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:54.503400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4dd937f7-2f14-4593-bdce-ba2e96d8d22a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:20:54.508947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4dd937f7-2f14-4593-bdce-ba2e96d8d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:54.537222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:20:54.564657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1139/2270] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:20:54.572462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75211b-24c9-48ea-8467-93a0fb8d6a1d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:54.572752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75211b-24c9-48ea-8467-93a0fb8d6a1d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:54.573033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75211b-24c9-48ea-8467-93a0fb8d6a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:54.592070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-3c75211b-24c9-48ea-8467-93a0fb8d6a1d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:20:54.593385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3c75211b-24c9-48ea-8467-93a0fb8d6a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:54.601385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1132/2271] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:20:54.606355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd937f7-2f14-4593-bdce-ba2e96d8d22a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:54.616094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd937f7-2f14-4593-bdce-ba2e96d8d22a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:54.620959 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:54.621618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:54.621910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:54.622222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:54.622975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:20:54.623284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:54.624889 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:54.642441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1140/2272] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:20:54.646241 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75211b-24c9-48ea-8467-93a0fb8d6a1d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:54.658353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75211b-24c9-48ea-8467-93a0fb8d6a1d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:54.663492 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22224-07bb-4e58-ad41-bd85fd169646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:54.664168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22224-07bb-4e58-ad41-bd85fd169646 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:54.664457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22224-07bb-4e58-ad41-bd85fd169646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:54.664936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22224-07bb-4e58-ad41-bd85fd169646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:54.666286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22224-07bb-4e58-ad41-bd85fd169646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:54.668391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22224-07bb-4e58-ad41-bd85fd169646 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:54.777990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1133/2273] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:20:54 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:20:54.780893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:54.791659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bde64-df2a-46d3-a283-3dfb404687a1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:54.846969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367a5b6-7f59-45d5-bfd3-98f04e35dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:54.847677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367a5b6-7f59-45d5-bfd3-98f04e35dddc admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:54.847965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367a5b6-7f59-45d5-bfd3-98f04e35dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:54.848246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367a5b6-7f59-45d5-bfd3-98f04e35dddc admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:54.848954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367a5b6-7f59-45d5-bfd3-98f04e35dddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:54.850952 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367a5b6-7f59-45d5-bfd3-98f04e35dddc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:54.979921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1141/2274] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:20:54 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:20:54.984080 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22224-07bb-4e58-ad41-bd85fd169646 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:54.994618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22224-07bb-4e58-ad41-bd85fd169646 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:54.999167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc1866-b4c0-4373-89c6-c958f41c116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:54.999921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1866-b4c0-4373-89c6-c958f41c116e admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:55.000205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1866-b4c0-4373-89c6-c958f41c116e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:55.000483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1866-b4c0-4373-89c6-c958f41c116e admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:55.001201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc1866-b4c0-4373-89c6-c958f41c116e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:55.002846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc1866-b4c0-4373-89c6-c958f41c116e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:55.004958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:20:55.014221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1134/2275] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:20:55.018336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367a5b6-7f59-45d5-bfd3-98f04e35dddc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:55.029289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367a5b6-7f59-45d5-bfd3-98f04e35dddc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:55.034182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61bd7d-4e51-4f21-af62-4bc64ac88337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:55.034945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61bd7d-4e51-4f21-af62-4bc64ac88337 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:55.035237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61bd7d-4e51-4f21-af62-4bc64ac88337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:55.035517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61bd7d-4e51-4f21-af62-4bc64ac88337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:55.036253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61bd7d-4e51-4f21-af62-4bc64ac88337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:55.037855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61bd7d-4e51-4f21-af62-4bc64ac88337 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:55.048315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1142/2276] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:20:55.052602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc1866-b4c0-4373-89c6-c958f41c116e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:55.063299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc1866-b4c0-4373-89c6-c958f41c116e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:55.068025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:55.068915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:55.069202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:55.069484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] PATH_INFO: `/v3/projects/d965a13a1593484b8ceeeb8f6d870efe/users/5a249c458f4d40a484ad51d33a9bdeac/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:55.084638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d965a13a1593484b8ceeeb8f6d870efe, user_id=5a249c458f4d40a484ad51d33a9bdeac, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:55.088183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:55.207438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1135/2277] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:20:55 2022] PUT /identity/v3/projects/d965a13a1593484b8ceeeb8f6d870efe/users/5a249c458f4d40a484ad51d33a9bdeac/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:20:55.213222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858ec9-8aa9-45e9-ab09-1d42ce099413 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:55.213536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858ec9-8aa9-45e9-ab09-1d42ce099413 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:55.213792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e858ec9-8aa9-45e9-ab09-1d42ce099413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:55.233699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1e858ec9-8aa9-45e9-ab09-1d42ce099413 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:20:55.235265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1e858ec9-8aa9-45e9-ab09-1d42ce099413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:55.297265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1143/2278] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:20:55.307231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:20:55.309164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:20:55.380062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454e858-0f00-4a15-943d-3b99c4449e56 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:20:55.385211 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7fb05-6833-4c9f-9fae-576b1b5b493c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:20:55.386027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7fb05-6833-4c9f-9fae-576b1b5b493c service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:20:55.386419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7fb05-6833-4c9f-9fae-576b1b5b493c service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:20:55.386802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7fb05-6833-4c9f-9fae-576b1b5b493c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:20:55.397287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7fb05-6833-4c9f-9fae-576b1b5b493c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:20:55.399070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7fb05-6833-4c9f-9fae-576b1b5b493c service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:20:55.412852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1136/2279] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:02.854350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec7f57-3110-4543-9574-4766a3ed16a2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:02.854851 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec7f57-3110-4543-9574-4766a3ed16a2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:02.855057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec7f57-3110-4543-9574-4766a3ed16a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:02.880128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-87ec7f57-3110-4543-9574-4766a3ed16a2 None None] MFA Rules not processed for user `4705101941674ef0839a6cff5d1bab2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:21:02.880128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-87ec7f57-3110-4543-9574-4766a3ed16a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:02.880542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc4994-3787-441e-b7da-334db2a0e10d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:02.880542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc4994-3787-441e-b7da-334db2a0e10d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:02.880542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc4994-3787-441e-b7da-334db2a0e10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:02.918769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c8bc4994-3787-441e-b7da-334db2a0e10d None None] MFA Rules not processed for user `5a249c458f4d40a484ad51d33a9bdeac`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:21:02.920045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c8bc4994-3787-441e-b7da-334db2a0e10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:02.924104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:02.943109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1144/2280] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:21:03.000705 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1137/2281] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:21:03.011034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec7f57-3110-4543-9574-4766a3ed16a2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:03.023104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec7f57-3110-4543-9574-4766a3ed16a2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:03.028336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:03.029005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:03.031002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:03.031002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:03.031002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:03.032286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:03.121949 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1145/2282] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:21:03 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:21:03.123781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc4994-3787-441e-b7da-334db2a0e10d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:03.135235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc4994-3787-441e-b7da-334db2a0e10d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:03.196600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45129-421e-4293-9f2e-6f859a2a4f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:03.197324 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45129-421e-4293-9f2e-6f859a2a4f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:03.197620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45129-421e-4293-9f2e-6f859a2a4f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:03.197949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45129-421e-4293-9f2e-6f859a2a4f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:03.198762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45129-421e-4293-9f2e-6f859a2a4f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:03.201028 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45129-421e-4293-9f2e-6f859a2a4f40 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:03.211027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:03.275805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:03.277790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:03.327299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1138/2283] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:21:03 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:21:03.332237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45129-421e-4293-9f2e-6f859a2a4f40 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:03.339196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f6f9-b26b-4d50-b066-8fd459bc29e4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:03.343268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:03.344118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:03.344531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:03.344884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:03.346387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45129-421e-4293-9f2e-6f859a2a4f40 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:03.346946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:03.351439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e1de8-a19f-463f-8de4-7e7f96b6aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:03.352134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1de8-a19f-463f-8de4-7e7f96b6aeab admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:03.352620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1de8-a19f-463f-8de4-7e7f96b6aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:03.353027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1de8-a19f-463f-8de4-7e7f96b6aeab admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:03.353854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e1de8-a19f-463f-8de4-7e7f96b6aeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:03.355686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e1de8-a19f-463f-8de4-7e7f96b6aeab admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:03.358676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:03.364452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:03.366693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1139/2284] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:21:03.370316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1146/2285] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:03.371284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e1de8-a19f-463f-8de4-7e7f96b6aeab admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:03.381689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e1de8-a19f-463f-8de4-7e7f96b6aeab admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:03.387937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54851058-0e1d-40e6-adb6-e4c6c642277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:03.388776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851058-0e1d-40e6-adb6-e4c6c642277e admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:03.389937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851058-0e1d-40e6-adb6-e4c6c642277e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:03.389937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851058-0e1d-40e6-adb6-e4c6c642277e admin admin] PATH_INFO: `/v3/projects/8f4a8f0e87f54e168fba0f484c13fe0e/users/7313f4dcc8e948ae8a430dc6f667362f/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:03.406502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54851058-0e1d-40e6-adb6-e4c6c642277e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4a8f0e87f54e168fba0f484c13fe0e, user_id=7313f4dcc8e948ae8a430dc6f667362f, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:03.409990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54851058-0e1d-40e6-adb6-e4c6c642277e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:03.518373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1140/2286] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:21:03 2022] PUT /identity/v3/projects/8f4a8f0e87f54e168fba0f484c13fe0e/users/7313f4dcc8e948ae8a430dc6f667362f/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:21:03.522761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:03.534942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3d974-9d36-410a-ba40-8a65b0ea774a service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:03.603390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba889b4-7206-4ecd-8885-9993a8382246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:03.604076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba889b4-7206-4ecd-8885-9993a8382246 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:03.604368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba889b4-7206-4ecd-8885-9993a8382246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:03.604872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba889b4-7206-4ecd-8885-9993a8382246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:03.605380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba889b4-7206-4ecd-8885-9993a8382246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:03.607387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba889b4-7206-4ecd-8885-9993a8382246 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:03.620516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1147/2287] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:21:03.624896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54851058-0e1d-40e6-adb6-e4c6c642277e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:03.636994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54851058-0e1d-40e6-adb6-e4c6c642277e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:03.642358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:03.643317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:03.647802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:03.647802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] PATH_INFO: `/v3/projects/8f4a8f0e87f54e168fba0f484c13fe0e/users/7313f4dcc8e948ae8a430dc6f667362f/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:03.647802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4a8f0e87f54e168fba0f484c13fe0e, user_id=7313f4dcc8e948ae8a430dc6f667362f, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:03.649328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:03.662432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1141/2288] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:21:03 2022] PUT /identity/v3/projects/8f4a8f0e87f54e168fba0f484c13fe0e/users/7313f4dcc8e948ae8a430dc6f667362f/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:21:10.381192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eae5ec-9234-48bd-9552-d07ac4cafa81 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:10.381634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eae5ec-9234-48bd-9552-d07ac4cafa81 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:10.382950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eae5ec-9234-48bd-9552-d07ac4cafa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:10.411742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-76eae5ec-9234-48bd-9552-d07ac4cafa81 None None] MFA Rules not processed for user `7313f4dcc8e948ae8a430dc6f667362f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:21:10.413343 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-76eae5ec-9234-48bd-9552-d07ac4cafa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:10.483268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:10.502419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1148/2289] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:21:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:21:10.516631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:10.518444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:10.597493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dae796-85e7-4995-b09a-1a504650a14a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:10.603441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:10.604093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:10.610394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:10.610394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:10.659668 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:10.661288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:10.670125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1142/2290] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:13.135764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9439d5-89e2-4416-807d-2b272ce4bb38 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:13.136331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9439d5-89e2-4416-807d-2b272ce4bb38 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:13.136331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9439d5-89e2-4416-807d-2b272ce4bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:13.154535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ad9439d5-89e2-4416-807d-2b272ce4bb38 None None] MFA Rules not processed for user `5a249c458f4d40a484ad51d33a9bdeac`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:21:13.155784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ad9439d5-89e2-4416-807d-2b272ce4bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:13.164612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1149/2291] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:21:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:21:15.523060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:15.525598 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:15.541683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b91b59-8372-40e8-9dae-14903e733abe service nova] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:15.547402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:15.548054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:15.548345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:15.548629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:15.550498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:15.563212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:15.564827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:15.575769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1143/2292] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:21:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:19.468692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9439d5-89e2-4416-807d-2b272ce4bb38 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:19.481626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9439d5-89e2-4416-807d-2b272ce4bb38 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:19.487046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:19.488808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:19.488808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:19.488808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:19.490156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:19.504326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:19.505990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:19.517579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1150/2293] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:25.570999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:29.513018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=13 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:32.016185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:32.017575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:32.073496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a6bd-a036-405d-bbb6-a92a0f0704e6 service nova] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:32.077093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711e92e-d1c7-4040-b6fe-f85de56c0624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:32.077738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711e92e-d1c7-4040-b6fe-f85de56c0624 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:32.078065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711e92e-d1c7-4040-b6fe-f85de56c0624 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:32.078349 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711e92e-d1c7-4040-b6fe-f85de56c0624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:32.080109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d711e92e-d1c7-4040-b6fe-f85de56c0624 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:32.137864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711e92e-d1c7-4040-b6fe-f85de56c0624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:32.139343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711e92e-d1c7-4040-b6fe-f85de56c0624 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:32.148266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1144/2294] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:32.375236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:32.384327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5b31-1770-4861-a0df-d13f2fafb4d8 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:32.388442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:32.389076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:32.389369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:32.389652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:32.391446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:32.451587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:32.452962 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:32.462381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1151/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:21:42.144370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=48 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:42.457856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=28 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:44.736089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c32ae-733f-4260-96cd-7a6668b6e984 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:44.737559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c32ae-733f-4260-96cd-7a6668b6e984 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:44.738313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c32ae-733f-4260-96cd-7a6668b6e984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:44.756621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-402c32ae-733f-4260-96cd-7a6668b6e984 None None] MFA Rules not processed for user `e32767611f7d417184f55c8e7fa645b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:21:44.757887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-402c32ae-733f-4260-96cd-7a6668b6e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:21:44.769310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1145/2296] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:21:54.752078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:59.777055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:21:59.830361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb1f7e-1eb2-41f1-b520-c4dd35126def service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:21:59.833911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:21:59.834588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:21:59.834870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:21:59.835153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:21:59.844583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:21:59.846116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:21:59.856066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1152/2297] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:21:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:01.662632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c32ae-733f-4260-96cd-7a6668b6e984 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:01.673030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c32ae-733f-4260-96cd-7a6668b6e984 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:01.677366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:01.678405 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:01.678858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:01.679301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:01.681099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:01.766856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:01.768377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:01.779301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1146/2298] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:06.281681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:06.283506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:06.298726 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbbd8d-480c-422c-9d79-684df2a0dc92 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:06.303222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:06.304131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:06.304416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:06.305121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] PATH_INFO: `/v3/users/00e99aa4e6c14e7bafa57df2c867e9a3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:06.305871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e99aa4e6c14e7bafa57df2c867e9a3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:06.308456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:06.503958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e99aa4e6c14e7bafa57df2c867e9a3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:06.511057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e99aa4e6c14e7bafa57df2c867e9a3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:06.599579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e99aa4e6c14e7bafa57df2c867e9a3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:06.600143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e99aa4e6c14e7bafa57df2c867e9a3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:06.600757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6c7ee18-5bf2-4b03-aff7-fc177feb5abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e99aa4e6c14e7bafa57df2c867e9a3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:06.618784 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1153/2299] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:22:06 2022] DELETE /identity/v3/users/00e99aa4e6c14e7bafa57df2c867e9a3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:06.869719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:06.881761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b317c4-d2ce-4a81-97a0-90bd558f813b service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:06.940940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:06.941803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:06.942114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:06.942421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] PATH_INFO: `/v3/projects/91a54feb061c49f59d63f3b21c6b9b6b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:06.943596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a54feb061c49f59d63f3b21c6b9b6b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:06.945521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:07.073528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a54feb061c49f59d63f3b21c6b9b6b', 'request_id': 'req-cd04dd55-8e63-49cd-9547-12069e4d2ade'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:07.079670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a54feb061c49f59d63f3b21c6b9b6b', 'request_id': 'req-cd04dd55-8e63-49cd-9547-12069e4d2ade'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:07.147880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a54feb061c49f59d63f3b21c6b9b6b', 'request_id': 'req-cd04dd55-8e63-49cd-9547-12069e4d2ade'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:07.159457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] The token cache is being invalidate because project 91a54feb061c49f59d63f3b21c6b9b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:22:07.159802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:07.160442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-cd04dd55-8e63-49cd-9547-12069e4d2ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:07.162014 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1147/2300] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:22:06 2022] DELETE /identity/v3/projects/91a54feb061c49f59d63f3b21c6b9b6b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:07.166968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84cb73-a474-4db0-82f2-7590064a4e52 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.169792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84cb73-a474-4db0-82f2-7590064a4e52 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.169792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84cb73-a474-4db0-82f2-7590064a4e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.185554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ca84cb73-a474-4db0-82f2-7590064a4e52 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:07.186834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ca84cb73-a474-4db0-82f2-7590064a4e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:07.245292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1154/2301] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:07.252887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36167-dd79-4a8a-ac42-e019efff26ec None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.253178 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36167-dd79-4a8a-ac42-e019efff26ec None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.253458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36167-dd79-4a8a-ac42-e019efff26ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.272804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7dc36167-dd79-4a8a-ac42-e019efff26ec None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:07.274002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7dc36167-dd79-4a8a-ac42-e019efff26ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:07.281609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1148/2302] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:07.286021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84cb73-a474-4db0-82f2-7590064a4e52 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:07.295583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84cb73-a474-4db0-82f2-7590064a4e52 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:07.300091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:07.300734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.301017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.301291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.302040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:22:07.302369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:07.303974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:07.315699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1155/2303] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:22:07.319714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc36167-dd79-4a8a-ac42-e019efff26ec None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:07.329181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc36167-dd79-4a8a-ac42-e019efff26ec None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:07.333739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf5153-9fc1-45d2-af06-27768e501631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:07.334415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf5153-9fc1-45d2-af06-27768e501631 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.334698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf5153-9fc1-45d2-af06-27768e501631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.334969 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf5153-9fc1-45d2-af06-27768e501631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.335658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf5153-9fc1-45d2-af06-27768e501631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:07.337624 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf5153-9fc1-45d2-af06-27768e501631 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:07.350775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:07.451298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1149/2304] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:22:07 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:22:07.455465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:07.460650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:07.465888 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997f93d-2d3a-440e-a6cc-89938bab4e96 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:07.521860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0515e5-6c67-4a05-adf4-3cd46b4ac40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:07.522551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0515e5-6c67-4a05-adf4-3cd46b4ac40b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.522844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0515e5-6c67-4a05-adf4-3cd46b4ac40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.523133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0515e5-6c67-4a05-adf4-3cd46b4ac40b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.523835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0515e5-6c67-4a05-adf4-3cd46b4ac40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:07.525808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0515e5-6c67-4a05-adf4-3cd46b4ac40b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:07.633910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1156/2305] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:22:07 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:07.638119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf5153-9fc1-45d2-af06-27768e501631 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:07.648345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf5153-9fc1-45d2-af06-27768e501631 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:07.652940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b2ff3-bb30-4381-b84b-24a122362cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:07.653591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b2ff3-bb30-4381-b84b-24a122362cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.655087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b2ff3-bb30-4381-b84b-24a122362cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.655087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b2ff3-bb30-4381-b84b-24a122362cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.655087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b2ff3-bb30-4381-b84b-24a122362cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:07.656516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b2ff3-bb30-4381-b84b-24a122362cf9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:07.667390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1150/2306] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:22:07.671166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0515e5-6c67-4a05-adf4-3cd46b4ac40b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:07.682062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0515e5-6c67-4a05-adf4-3cd46b4ac40b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:07.687903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55586774-5f01-43d3-9468-6ddc0d521dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:07.688572 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586774-5f01-43d3-9468-6ddc0d521dab admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.688862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586774-5f01-43d3-9468-6ddc0d521dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.689139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586774-5f01-43d3-9468-6ddc0d521dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.689914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55586774-5f01-43d3-9468-6ddc0d521dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:07.691600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55586774-5f01-43d3-9468-6ddc0d521dab admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:07.702333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1157/2307] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:07.706421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b2ff3-bb30-4381-b84b-24a122362cf9 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:07.716763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b2ff3-bb30-4381-b84b-24a122362cf9 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:07.721813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e342fa9-51e0-4aed-bc70-8ee4491342fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:07.722726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e342fa9-51e0-4aed-bc70-8ee4491342fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.723012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e342fa9-51e0-4aed-bc70-8ee4491342fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.723290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e342fa9-51e0-4aed-bc70-8ee4491342fe admin admin] PATH_INFO: `/v3/projects/fdff33ad82cd447082460d0477b63a2d/users/29e79cc1139943e28bf3a40bdd039d8a/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.742840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e342fa9-51e0-4aed-bc70-8ee4491342fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdff33ad82cd447082460d0477b63a2d, user_id=29e79cc1139943e28bf3a40bdd039d8a, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:07.746358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e342fa9-51e0-4aed-bc70-8ee4491342fe admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:07.858301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1151/2308] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:07 2022] PUT /identity/v3/projects/fdff33ad82cd447082460d0477b63a2d/users/29e79cc1139943e28bf3a40bdd039d8a/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:07.870133 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f61ff-11b2-4711-a29e-d43910b2e798 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:07.870461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f61ff-11b2-4711-a29e-d43910b2e798 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:07.870748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f61ff-11b2-4711-a29e-d43910b2e798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:07.897528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b16f61ff-11b2-4711-a29e-d43910b2e798 None None] MFA Rules not processed for user `29e79cc1139943e28bf3a40bdd039d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:07.901378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b16f61ff-11b2-4711-a29e-d43910b2e798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:07.962234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1158/2309] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:07.967216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e342fa9-51e0-4aed-bc70-8ee4491342fe admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:08.028764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e342fa9-51e0-4aed-bc70-8ee4491342fe admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:08.033658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8568e-2131-4ac6-8e2e-621004d98bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:08.034345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8568e-2131-4ac6-8e2e-621004d98bed admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:08.034638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8568e-2131-4ac6-8e2e-621004d98bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:08.034922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8568e-2131-4ac6-8e2e-621004d98bed admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:08.035608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8568e-2131-4ac6-8e2e-621004d98bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:08.037520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8568e-2131-4ac6-8e2e-621004d98bed admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:08.121322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1152/2310] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:22:07 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:08.125392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f61ff-11b2-4711-a29e-d43910b2e798 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:08.136081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f61ff-11b2-4711-a29e-d43910b2e798 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:08.192958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec044c-d8db-4435-8373-2b0c82f9d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:08.193657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec044c-d8db-4435-8373-2b0c82f9d413 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:08.193942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec044c-d8db-4435-8373-2b0c82f9d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:08.194260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec044c-d8db-4435-8373-2b0c82f9d413 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:08.194938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec044c-d8db-4435-8373-2b0c82f9d413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:08.196889 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec044c-d8db-4435-8373-2b0c82f9d413 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:08.283189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:08.288254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1159/2311] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:22:08 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:08.292797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8568e-2131-4ac6-8e2e-621004d98bed admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:08.303036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8568e-2131-4ac6-8e2e-621004d98bed admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:08.308052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a48b5-3c22-410c-be0c-14588eb12f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:08.308731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a48b5-3c22-410c-be0c-14588eb12f52 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:08.309164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a48b5-3c22-410c-be0c-14588eb12f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:08.309456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a48b5-3c22-410c-be0c-14588eb12f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:08.310272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a48b5-3c22-410c-be0c-14588eb12f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:08.311945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a48b5-3c22-410c-be0c-14588eb12f52 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:08.323760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1153/2312] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:08.328005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec044c-d8db-4435-8373-2b0c82f9d413 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:08.338988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec044c-d8db-4435-8373-2b0c82f9d413 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:08.343706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf758db-c747-4442-b084-66482dff0029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:08.344580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf758db-c747-4442-b084-66482dff0029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:08.344867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf758db-c747-4442-b084-66482dff0029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:08.345146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf758db-c747-4442-b084-66482dff0029 admin admin] PATH_INFO: `/v3/projects/43650e8f5cd246d4952eae0e54d04db4/users/a36dbc6b80c84228826eab79008ae954/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:08.360286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf758db-c747-4442-b084-66482dff0029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43650e8f5cd246d4952eae0e54d04db4, user_id=a36dbc6b80c84228826eab79008ae954, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:08.363059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf758db-c747-4442-b084-66482dff0029 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:08.470566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1160/2313] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:08 2022] PUT /identity/v3/projects/43650e8f5cd246d4952eae0e54d04db4/users/a36dbc6b80c84228826eab79008ae954/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:08.474446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a48b5-3c22-410c-be0c-14588eb12f52 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:08.485021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a48b5-3c22-410c-be0c-14588eb12f52 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:08.541214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35849ac9-46d6-4241-bdac-0e54056fd0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:08.541804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849ac9-46d6-4241-bdac-0e54056fd0dd admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:08.542126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849ac9-46d6-4241-bdac-0e54056fd0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:08.542409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35849ac9-46d6-4241-bdac-0e54056fd0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:08.543131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35849ac9-46d6-4241-bdac-0e54056fd0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:08.544741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35849ac9-46d6-4241-bdac-0e54056fd0dd admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:08.554373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1154/2314] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:08.559027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf758db-c747-4442-b084-66482dff0029 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:08.569439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf758db-c747-4442-b084-66482dff0029 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:08.574265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:08.575059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:08.575349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:08.575634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] PATH_INFO: `/v3/projects/43650e8f5cd246d4952eae0e54d04db4/users/a36dbc6b80c84228826eab79008ae954/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:08.577610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43650e8f5cd246d4952eae0e54d04db4, user_id=a36dbc6b80c84228826eab79008ae954, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:08.580301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:08.590720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1161/2315] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:08 2022] PUT /identity/v3/projects/43650e8f5cd246d4952eae0e54d04db4/users/a36dbc6b80c84228826eab79008ae954/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:08.600480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75789d02-48fa-4b22-b9f2-93eae658c095 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:08.615992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75789d02-48fa-4b22-b9f2-93eae658c095 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:08.615992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75789d02-48fa-4b22-b9f2-93eae658c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:08.628074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-75789d02-48fa-4b22-b9f2-93eae658c095 None None] MFA Rules not processed for user `a36dbc6b80c84228826eab79008ae954`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:08.629276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-75789d02-48fa-4b22-b9f2-93eae658c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:08.638491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:08.697063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1155/2316] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:08.708551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:08.710254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:08.767304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223de95e-f820-4ce2-8e23-0b0d09ab5378 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:08.771033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e4b82-57c9-49e7-9706-154ac68b69f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:08.771680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4b82-57c9-49e7-9706-154ac68b69f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:08.771969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4b82-57c9-49e7-9706-154ac68b69f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:08.772251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4b82-57c9-49e7-9706-154ac68b69f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:08.781106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e4b82-57c9-49e7-9706-154ac68b69f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:08.782850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e4b82-57c9-49e7-9706-154ac68b69f2 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:08.792207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1162/2317] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:09.721732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75789d02-48fa-4b22-b9f2-93eae658c095 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:09.786375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75789d02-48fa-4b22-b9f2-93eae658c095 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:09.791523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:09.792383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:09.792663 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:09.792934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] PATH_INFO: `/v3/users/29e79cc1139943e28bf3a40bdd039d8a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:09.794146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e79cc1139943e28bf3a40bdd039d8a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:09.796081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:09.970536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e79cc1139943e28bf3a40bdd039d8a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:09.977536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e79cc1139943e28bf3a40bdd039d8a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:09.978343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e79cc1139943e28bf3a40bdd039d8a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:09.978964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e79cc1139943e28bf3a40bdd039d8a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:10.044974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e79cc1139943e28bf3a40bdd039d8a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:10.063900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1156/2318] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:22:09 2022] DELETE /identity/v3/users/29e79cc1139943e28bf3a40bdd039d8a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:10.068395 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de1f7-ddff-47ba-b727-ada792656a47 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:10.068894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de1f7-ddff-47ba-b727-ada792656a47 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:10.069006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de1f7-ddff-47ba-b727-ada792656a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:10.086735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6d4de1f7-ddff-47ba-b727-ada792656a47 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:10.088564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6d4de1f7-ddff-47ba-b727-ada792656a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:10.145532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1163/2319] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:10.156137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:10.157844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:10.189873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:10.216774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa90bf-6a1b-4616-ba8d-5e203881071a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:10.220494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bb1bb-8e99-49d1-b6df-69f0315f5bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:10.221190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb1bb-8e99-49d1-b6df-69f0315f5bdd service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:10.221465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb1bb-8e99-49d1-b6df-69f0315f5bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:10.221750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb1bb-8e99-49d1-b6df-69f0315f5bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:10.231871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bb1bb-8e99-49d1-b6df-69f0315f5bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:10.233345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bb1bb-8e99-49d1-b6df-69f0315f5bdd service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:10.243008 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1157/2320] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:10.666609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4de1f7-ddff-47ba-b727-ada792656a47 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:10.668623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6d4de1f7-ddff-47ba-b727-ada792656a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:10.680748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4de1f7-ddff-47ba-b727-ada792656a47 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:10.686232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:10.687284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:10.687676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:10.688053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] PATH_INFO: `/v3/projects/fdff33ad82cd447082460d0477b63a2d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:10.689166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdff33ad82cd447082460d0477b63a2d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:10.691169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:10.809679 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdff33ad82cd447082460d0477b63a2d', 'request_id': 'req-4e0b847f-7418-49b9-8ca8-2b4d0689536b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:10.864614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdff33ad82cd447082460d0477b63a2d', 'request_id': 'req-4e0b847f-7418-49b9-8ca8-2b4d0689536b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:10.871667 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdff33ad82cd447082460d0477b63a2d', 'request_id': 'req-4e0b847f-7418-49b9-8ca8-2b4d0689536b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:10.872915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:10.882476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] The token cache is being invalidate because project fdff33ad82cd447082460d0477b63a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:22:10.882765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:10.883392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:10.885022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1164/2321] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:22:10 2022] DELETE /identity/v3/projects/fdff33ad82cd447082460d0477b63a2d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:10.889085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bb1bb-8e99-49d1-b6df-69f0315f5bdd service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:10.898795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bb1bb-8e99-49d1-b6df-69f0315f5bdd service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:10.957031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:10.957937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:10.958288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:10.958574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] PATH_INFO: `/v3/users/a36dbc6b80c84228826eab79008ae954` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:10.959786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36dbc6b80c84228826eab79008ae954)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:10.961769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:11.110331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36dbc6b80c84228826eab79008ae954'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.117219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36dbc6b80c84228826eab79008ae954'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.117890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36dbc6b80c84228826eab79008ae954'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.119969 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36dbc6b80c84228826eab79008ae954'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.207780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-92e8ad10-298a-42e7-95cc-6d2f9453c2d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36dbc6b80c84228826eab79008ae954'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.226357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1158/2322] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:22:10 2022] DELETE /identity/v3/users/a36dbc6b80c84228826eab79008ae954 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:11.597486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:11.599025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:11.612220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b847f-7418-49b9-8ca8-2b4d0689536b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:11.669019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:11.669799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:11.670116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:11.670387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] PATH_INFO: `/v3/projects/43650e8f5cd246d4952eae0e54d04db4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:11.671553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43650e8f5cd246d4952eae0e54d04db4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:11.673489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:11.763406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43650e8f5cd246d4952eae0e54d04db4', 'request_id': 'req-1e27cc75-1505-431c-8144-3420740e1619'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.830438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43650e8f5cd246d4952eae0e54d04db4', 'request_id': 'req-1e27cc75-1505-431c-8144-3420740e1619'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.836906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43650e8f5cd246d4952eae0e54d04db4', 'request_id': 'req-1e27cc75-1505-431c-8144-3420740e1619'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.847243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] The token cache is being invalidate because project 43650e8f5cd246d4952eae0e54d04db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:22:11.847535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.848219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e27cc75-1505-431c-8144-3420740e1619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:11.849761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1165/2323] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:22:11 2022] DELETE /identity/v3/projects/43650e8f5cd246d4952eae0e54d04db4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:11.854680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b2f9-0f81-4fc6-b852-f8144260b805 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:11.854972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b2f9-0f81-4fc6-b852-f8144260b805 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:11.855276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b2f9-0f81-4fc6-b852-f8144260b805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:11.872704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-6be7b2f9-0f81-4fc6-b852-f8144260b805 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:11.873894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6be7b2f9-0f81-4fc6-b852-f8144260b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:11.917793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:11.932991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1159/2324] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:11.940894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28548fa3-fda8-4ed0-8b21-4b490bd5387e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:11.941196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28548fa3-fda8-4ed0-8b21-4b490bd5387e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:11.941484 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28548fa3-fda8-4ed0-8b21-4b490bd5387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:11.959854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-28548fa3-fda8-4ed0-8b21-4b490bd5387e None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:11.961049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-28548fa3-fda8-4ed0-8b21-4b490bd5387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:11.968983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1166/2325] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:11.974156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b2f9-0f81-4fc6-b852-f8144260b805 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:11.982398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b2f9-0f81-4fc6-b852-f8144260b805 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:11.987622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:11.988421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:11.988985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:11.989263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:11.990004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:22:11.990318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:11.991912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.003740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1160/2326] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:22:12.007832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28548fa3-fda8-4ed0-8b21-4b490bd5387e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.017640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28548fa3-fda8-4ed0-8b21-4b490bd5387e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.022416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b364f8-180d-4fab-9f83-2924e1f584c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.023076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b364f8-180d-4fab-9f83-2924e1f584c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.023350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b364f8-180d-4fab-9f83-2924e1f584c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.023630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b364f8-180d-4fab-9f83-2924e1f584c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.024328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b364f8-180d-4fab-9f83-2924e1f584c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.026272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b364f8-180d-4fab-9f83-2924e1f584c5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.120830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1167/2327] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:22:12 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:12.125691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.135731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72cbf7-ef28-4f3f-b919-6c2dddc669dc admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.192746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044b94-20ff-484a-98c0-ebd30f8a95cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.193340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044b94-20ff-484a-98c0-ebd30f8a95cf admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.193627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044b94-20ff-484a-98c0-ebd30f8a95cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.193903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044b94-20ff-484a-98c0-ebd30f8a95cf admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.194633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044b94-20ff-484a-98c0-ebd30f8a95cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.196547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044b94-20ff-484a-98c0-ebd30f8a95cf admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.299193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1161/2328] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:22:12 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:12.303270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b364f8-180d-4fab-9f83-2924e1f584c5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.314534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b364f8-180d-4fab-9f83-2924e1f584c5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.319388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325830ef-73a3-4d26-9321-e0dbe3291628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.320052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325830ef-73a3-4d26-9321-e0dbe3291628 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.320340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325830ef-73a3-4d26-9321-e0dbe3291628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.320622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325830ef-73a3-4d26-9321-e0dbe3291628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.321361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325830ef-73a3-4d26-9321-e0dbe3291628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.323051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325830ef-73a3-4d26-9321-e0dbe3291628 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.333585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1168/2329] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:12.337381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044b94-20ff-484a-98c0-ebd30f8a95cf admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.347563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044b94-20ff-484a-98c0-ebd30f8a95cf admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.352153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f7509-47ae-4111-adb3-5a66f5c378d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.352806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7509-47ae-4111-adb3-5a66f5c378d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.353616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7509-47ae-4111-adb3-5a66f5c378d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.353895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f7509-47ae-4111-adb3-5a66f5c378d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.354646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f7509-47ae-4111-adb3-5a66f5c378d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.356250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f7509-47ae-4111-adb3-5a66f5c378d8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.366415 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1162/2330] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:12.370614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325830ef-73a3-4d26-9321-e0dbe3291628 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.380507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325830ef-73a3-4d26-9321-e0dbe3291628 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.385187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3c46b-8306-4eb3-9695-17a6dc1231d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.386080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3c46b-8306-4eb3-9695-17a6dc1231d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.386369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3c46b-8306-4eb3-9695-17a6dc1231d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.386649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3c46b-8306-4eb3-9695-17a6dc1231d6 admin admin] PATH_INFO: `/v3/projects/8daa2372e7914b29bd52c61ec00dbd5c/users/8a8f26ace1de440ebe865a6cd48cea21/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.401742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3c46b-8306-4eb3-9695-17a6dc1231d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8daa2372e7914b29bd52c61ec00dbd5c, user_id=8a8f26ace1de440ebe865a6cd48cea21, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.404553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3c46b-8306-4eb3-9695-17a6dc1231d6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.498717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1169/2331] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:12 2022] PUT /identity/v3/projects/8daa2372e7914b29bd52c61ec00dbd5c/users/8a8f26ace1de440ebe865a6cd48cea21/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:12.509843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a02d-84dd-4160-bcfc-c79d102eddfe None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.512820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a02d-84dd-4160-bcfc-c79d102eddfe None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.512820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a02d-84dd-4160-bcfc-c79d102eddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.537708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-e532a02d-84dd-4160-bcfc-c79d102eddfe None None] MFA Rules not processed for user `8a8f26ace1de440ebe865a6cd48cea21`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:12.538952 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e532a02d-84dd-4160-bcfc-c79d102eddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:12.601114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1163/2332] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:12.606246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3c46b-8306-4eb3-9695-17a6dc1231d6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.623552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:12.667896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3c46b-8306-4eb3-9695-17a6dc1231d6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.672673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e7546-751f-4984-80b1-3ae9fe94d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.673331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7546-751f-4984-80b1-3ae9fe94d27a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.673616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7546-751f-4984-80b1-3ae9fe94d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.673890 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e7546-751f-4984-80b1-3ae9fe94d27a admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.674622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e7546-751f-4984-80b1-3ae9fe94d27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.676534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e7546-751f-4984-80b1-3ae9fe94d27a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.764267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1170/2333] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:22:12 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:12.768528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532a02d-84dd-4160-bcfc-c79d102eddfe None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.779738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532a02d-84dd-4160-bcfc-c79d102eddfe None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.821532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:12.838148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95d667-2cfc-4625-a392-3d8afa09072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.838830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95d667-2cfc-4625-a392-3d8afa09072d admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.840176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95d667-2cfc-4625-a392-3d8afa09072d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.840458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95d667-2cfc-4625-a392-3d8afa09072d admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.841398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95d667-2cfc-4625-a392-3d8afa09072d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.843676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95d667-2cfc-4625-a392-3d8afa09072d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.916395 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1164/2334] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:22:12 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:12.920501 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e7546-751f-4984-80b1-3ae9fe94d27a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.930793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e7546-751f-4984-80b1-3ae9fe94d27a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.935428 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468aab7-d246-43b3-bb7a-7d8d25c77b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.936088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468aab7-d246-43b3-bb7a-7d8d25c77b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.936378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468aab7-d246-43b3-bb7a-7d8d25c77b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.936659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468aab7-d246-43b3-bb7a-7d8d25c77b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.937383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468aab7-d246-43b3-bb7a-7d8d25c77b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.939019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468aab7-d246-43b3-bb7a-7d8d25c77b37 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.950691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1171/2335] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:12.954627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95d667-2cfc-4625-a392-3d8afa09072d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.964980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95d667-2cfc-4625-a392-3d8afa09072d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:12.969550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f45b2-32b8-4977-8d56-660be4874711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:12.970255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f45b2-32b8-4977-8d56-660be4874711 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:12.970546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f45b2-32b8-4977-8d56-660be4874711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:12.970829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f45b2-32b8-4977-8d56-660be4874711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:12.971550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f45b2-32b8-4977-8d56-660be4874711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:12.973141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f45b2-32b8-4977-8d56-660be4874711 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:12.982831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1165/2336] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:12.986742 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468aab7-d246-43b3-bb7a-7d8d25c77b37 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:12.996478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468aab7-d246-43b3-bb7a-7d8d25c77b37 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:13.001175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9dc4e-a764-4a57-8fb2-03d9c01379e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:13.001985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9dc4e-a764-4a57-8fb2-03d9c01379e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.002291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9dc4e-a764-4a57-8fb2-03d9c01379e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.002567 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9dc4e-a764-4a57-8fb2-03d9c01379e9 admin admin] PATH_INFO: `/v3/projects/c63e844b118c43ed8e255978edcf5eda/users/2b6e39cbfea84db0b2fd17fe581071a5/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.016983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9dc4e-a764-4a57-8fb2-03d9c01379e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63e844b118c43ed8e255978edcf5eda, user_id=2b6e39cbfea84db0b2fd17fe581071a5, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:13.019666 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9dc4e-a764-4a57-8fb2-03d9c01379e9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:13.091899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1172/2337] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:12 2022] PUT /identity/v3/projects/c63e844b118c43ed8e255978edcf5eda/users/2b6e39cbfea84db0b2fd17fe581071a5/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:13.102031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdc87-d992-465c-b408-0e5bbea9af70 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.102329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdc87-d992-465c-b408-0e5bbea9af70 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.102605 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdc87-d992-465c-b408-0e5bbea9af70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.128274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2a9fdc87-d992-465c-b408-0e5bbea9af70 None None] MFA Rules not processed for user `2b6e39cbfea84db0b2fd17fe581071a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:13.129464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2a9fdc87-d992-465c-b408-0e5bbea9af70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:13.193546 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1166/2338] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:13.198485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9dc4e-a764-4a57-8fb2-03d9c01379e9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:13.258978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9dc4e-a764-4a57-8fb2-03d9c01379e9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:13.263446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42e22-b887-47c2-a3e0-fe08137c5145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:13.264100 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42e22-b887-47c2-a3e0-fe08137c5145 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.264384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42e22-b887-47c2-a3e0-fe08137c5145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.264659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42e22-b887-47c2-a3e0-fe08137c5145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.265374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c42e22-b887-47c2-a3e0-fe08137c5145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:13.267320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c42e22-b887-47c2-a3e0-fe08137c5145 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:13.372093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1173/2339] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:22:13 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:13.376174 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fdc87-d992-465c-b408-0e5bbea9af70 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:13.386845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fdc87-d992-465c-b408-0e5bbea9af70 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:13.443151 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8900-4e0c-46a0-8776-6f01031a095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:13.443819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8900-4e0c-46a0-8776-6f01031a095e admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.444104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8900-4e0c-46a0-8776-6f01031a095e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.444382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8900-4e0c-46a0-8776-6f01031a095e admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.445073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca8900-4e0c-46a0-8776-6f01031a095e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:13.447042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca8900-4e0c-46a0-8776-6f01031a095e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:13.519240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1167/2340] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:22:13 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:13.523176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42e22-b887-47c2-a3e0-fe08137c5145 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:13.534318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42e22-b887-47c2-a3e0-fe08137c5145 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:13.538974 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351a42b-ba24-4272-aceb-451abfbccc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:13.539630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351a42b-ba24-4272-aceb-451abfbccc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.539938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351a42b-ba24-4272-aceb-451abfbccc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.540202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351a42b-ba24-4272-aceb-451abfbccc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.541576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351a42b-ba24-4272-aceb-451abfbccc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:13.543235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351a42b-ba24-4272-aceb-451abfbccc8c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:13.553643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1174/2341] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:13.557625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8900-4e0c-46a0-8776-6f01031a095e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:13.567532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8900-4e0c-46a0-8776-6f01031a095e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:13.572578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23652bc-d12f-4a3f-ad51-46a78d45a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:13.573438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23652bc-d12f-4a3f-ad51-46a78d45a67d admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.573725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23652bc-d12f-4a3f-ad51-46a78d45a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.574030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23652bc-d12f-4a3f-ad51-46a78d45a67d admin admin] PATH_INFO: `/v3/projects/2928e0b68bde468383299b972e36dc83/users/1b1844e584be452787a0ebf8edd16c90/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.588875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23652bc-d12f-4a3f-ad51-46a78d45a67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2928e0b68bde468383299b972e36dc83, user_id=1b1844e584be452787a0ebf8edd16c90, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:13.591564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23652bc-d12f-4a3f-ad51-46a78d45a67d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:13.662424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1168/2342] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:13 2022] PUT /identity/v3/projects/2928e0b68bde468383299b972e36dc83/users/1b1844e584be452787a0ebf8edd16c90/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:13.666283 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351a42b-ba24-4272-aceb-451abfbccc8c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:13.676435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351a42b-ba24-4272-aceb-451abfbccc8c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:13.715219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:13.733533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f68be-897e-4d50-b077-7c22c7f39045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:13.734295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f68be-897e-4d50-b077-7c22c7f39045 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.734582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f68be-897e-4d50-b077-7c22c7f39045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.734858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f68be-897e-4d50-b077-7c22c7f39045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.735583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f68be-897e-4d50-b077-7c22c7f39045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:13.737226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f68be-897e-4d50-b077-7c22c7f39045 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:13.747686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1175/2343] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:13.751774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23652bc-d12f-4a3f-ad51-46a78d45a67d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:13.762828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23652bc-d12f-4a3f-ad51-46a78d45a67d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:13.767430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:13.770466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.770466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.770466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] PATH_INFO: `/v3/projects/2928e0b68bde468383299b972e36dc83/users/1b1844e584be452787a0ebf8edd16c90/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.771012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2928e0b68bde468383299b972e36dc83, user_id=1b1844e584be452787a0ebf8edd16c90, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:13.773643 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:13.784804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1169/2344] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:13 2022] PUT /identity/v3/projects/2928e0b68bde468383299b972e36dc83/users/1b1844e584be452787a0ebf8edd16c90/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:13.794798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84cc1-5206-4301-965e-ccb71c25a352 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.795089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84cc1-5206-4301-965e-ccb71c25a352 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.795366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84cc1-5206-4301-965e-ccb71c25a352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.822556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7fe84cc1-5206-4301-965e-ccb71c25a352 None None] MFA Rules not processed for user `1b1844e584be452787a0ebf8edd16c90`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:13.823758 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7fe84cc1-5206-4301-965e-ccb71c25a352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:13.889923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1176/2345] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:13.901081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:13.902860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:13.909565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:13.960367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7919233-d7bd-4dd9-92e0-78f05878aa90 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:13.964196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d60d2-40d4-42c0-90d7-a8e795c473f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:13.964838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d60d2-40d4-42c0-90d7-a8e795c473f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:13.965122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d60d2-40d4-42c0-90d7-a8e795c473f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:13.965401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d60d2-40d4-42c0-90d7-a8e795c473f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:13.974414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d60d2-40d4-42c0-90d7-a8e795c473f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:13.975889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d60d2-40d4-42c0-90d7-a8e795c473f8 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:13.985846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1170/2346] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:15.150263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe84cc1-5206-4301-965e-ccb71c25a352 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:15.151826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7fe84cc1-5206-4301-965e-ccb71c25a352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:15.165069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe84cc1-5206-4301-965e-ccb71c25a352 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:15.169309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9f09-8138-488b-854d-b8d8e74321e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:15.170019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9f09-8138-488b-854d-b8d8e74321e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:15.170296 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9f09-8138-488b-854d-b8d8e74321e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:15.170566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9f09-8138-488b-854d-b8d8e74321e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:15.236214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd9f09-8138-488b-854d-b8d8e74321e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:15.237695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd9f09-8138-488b-854d-b8d8e74321e5 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:15.249130 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1177/2347] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:20.151946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d60d2-40d4-42c0-90d7-a8e795c473f8 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:20.160698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d60d2-40d4-42c0-90d7-a8e795c473f8 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:20.164450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f81ce-5115-423d-9a2d-c6a941147705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:20.165237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f81ce-5115-423d-9a2d-c6a941147705 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:20.165534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f81ce-5115-423d-9a2d-c6a941147705 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:20.165819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f81ce-5115-423d-9a2d-c6a941147705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:20.223858 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f81ce-5115-423d-9a2d-c6a941147705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:20.225198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f81ce-5115-423d-9a2d-c6a941147705 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:20.234003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1171/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:24.286921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9f09-8138-488b-854d-b8d8e74321e5 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:24.348839 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9f09-8138-488b-854d-b8d8e74321e5 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:24.353790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:24.354678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:24.354962 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:24.355237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] PATH_INFO: `/v3/users/8a8f26ace1de440ebe865a6cd48cea21` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:24.356398 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8f26ace1de440ebe865a6cd48cea21)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:24.358349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:24.359830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:24.575050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8f26ace1de440ebe865a6cd48cea21'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:24.581887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8f26ace1de440ebe865a6cd48cea21'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:24.647284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8f26ace1de440ebe865a6cd48cea21'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:24.647895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8f26ace1de440ebe865a6cd48cea21'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:24.648523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8f26ace1de440ebe865a6cd48cea21'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:24.666886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1178/2349] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:22:24 2022] DELETE /identity/v3/users/8a8f26ace1de440ebe865a6cd48cea21 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:24.671472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360281c-98a4-45d4-b03f-188288b0d966 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:24.671949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360281c-98a4-45d4-b03f-188288b0d966 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:24.672048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360281c-98a4-45d4-b03f-188288b0d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:24.688746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d360281c-98a4-45d4-b03f-188288b0d966 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:24.689974 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d360281c-98a4-45d4-b03f-188288b0d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:24.748819 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1172/2350] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:22:24.758424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:24.759902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:24.816332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470738-f25e-4422-990b-7c929cdf08eb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:24.820031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc4007-9f07-40bc-ad0f-1c2cb70733d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:24.820680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc4007-9f07-40bc-ad0f-1c2cb70733d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:24.820971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc4007-9f07-40bc-ad0f-1c2cb70733d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:24.821765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc4007-9f07-40bc-ad0f-1c2cb70733d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:24.830970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc4007-9f07-40bc-ad0f-1c2cb70733d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:24.832430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc4007-9f07-40bc-ad0f-1c2cb70733d0 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:24.842628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1179/2351] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:25.226288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360281c-98a4-45d4-b03f-188288b0d966 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:25.227749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d360281c-98a4-45d4-b03f-188288b0d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:25.242071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360281c-98a4-45d4-b03f-188288b0d966 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:25.248255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:25.249135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:25.249424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:25.249770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] PATH_INFO: `/v3/projects/8daa2372e7914b29bd52c61ec00dbd5c` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:25.251224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8daa2372e7914b29bd52c61ec00dbd5c)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:25.253165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:25.374616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:25.380526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8daa2372e7914b29bd52c61ec00dbd5c', 'request_id': 'req-c2ecd23b-e800-486f-a776-a58780adf904'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.387331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8daa2372e7914b29bd52c61ec00dbd5c', 'request_id': 'req-c2ecd23b-e800-486f-a776-a58780adf904'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.470670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8daa2372e7914b29bd52c61ec00dbd5c', 'request_id': 'req-c2ecd23b-e800-486f-a776-a58780adf904'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.480996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] The token cache is being invalidate because project 8daa2372e7914b29bd52c61ec00dbd5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:22:25.481282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.481932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.483491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1173/2352] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:22:25 2022] DELETE /identity/v3/projects/8daa2372e7914b29bd52c61ec00dbd5c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:25.487433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc4007-9f07-40bc-ad0f-1c2cb70733d0 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:25.498186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc4007-9f07-40bc-ad0f-1c2cb70733d0 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:25.554408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:25.555302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:25.555651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:25.556504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] PATH_INFO: `/v3/users/2b6e39cbfea84db0b2fd17fe581071a5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:25.557702 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6e39cbfea84db0b2fd17fe581071a5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:25.559676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:25.582059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:25.790813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6e39cbfea84db0b2fd17fe581071a5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.798291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6e39cbfea84db0b2fd17fe581071a5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.867465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6e39cbfea84db0b2fd17fe581071a5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.868119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6e39cbfea84db0b2fd17fe581071a5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.869301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6e39cbfea84db0b2fd17fe581071a5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:25.886614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1180/2353] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:22:25 2022] DELETE /identity/v3/users/2b6e39cbfea84db0b2fd17fe581071a5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:22:26.326901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:26.328342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:26.341209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd23b-e800-486f-a776-a58780adf904 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:26.397550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:26.398452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:26.398732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:26.398999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] PATH_INFO: `/v3/projects/c63e844b118c43ed8e255978edcf5eda` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:26.400168 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63e844b118c43ed8e255978edcf5eda)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:26.402136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:26.513161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63e844b118c43ed8e255978edcf5eda', 'request_id': 'req-3299e924-de5f-489f-b623-78e2bd085bb9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:26.519339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63e844b118c43ed8e255978edcf5eda', 'request_id': 'req-3299e924-de5f-489f-b623-78e2bd085bb9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:26.688263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63e844b118c43ed8e255978edcf5eda', 'request_id': 'req-3299e924-de5f-489f-b623-78e2bd085bb9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:26.699527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] The token cache is being invalidate because project c63e844b118c43ed8e255978edcf5eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:22:26.699848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:26.700483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:26.702081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1174/2354] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:22:26 2022] DELETE /identity/v3/projects/c63e844b118c43ed8e255978edcf5eda => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:26.706079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:26.707677 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:26.721116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9b668-c2b3-4f8b-b71d-652c6b374c5c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:26.778011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:26.778881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:26.779161 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:26.779436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] PATH_INFO: `/v3/users/1b1844e584be452787a0ebf8edd16c90` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:26.780601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1844e584be452787a0ebf8edd16c90)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:26.782835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:27.021783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1844e584be452787a0ebf8edd16c90'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.028511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1844e584be452787a0ebf8edd16c90'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.104802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1844e584be452787a0ebf8edd16c90'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.105417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1844e584be452787a0ebf8edd16c90'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.106072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-39560e5c-c725-4f2f-a218-d2e9b92cc92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1844e584be452787a0ebf8edd16c90'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.124696 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1181/2355] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:22:26 2022] DELETE /identity/v3/users/1b1844e584be452787a0ebf8edd16c90 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:27.517573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:27.519201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:27.532734 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299e924-de5f-489f-b623-78e2bd085bb9 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:27.590087 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:27.590955 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:27.591242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:27.591522 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] PATH_INFO: `/v3/projects/2928e0b68bde468383299b972e36dc83` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:27.592684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2928e0b68bde468383299b972e36dc83)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:27.594645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:27.596100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:27.720158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2928e0b68bde468383299b972e36dc83', 'request_id': 'req-926c16f8-c55a-4e9c-a4b6-758a8da89db4'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.726328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2928e0b68bde468383299b972e36dc83', 'request_id': 'req-926c16f8-c55a-4e9c-a4b6-758a8da89db4'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.807835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2928e0b68bde468383299b972e36dc83', 'request_id': 'req-926c16f8-c55a-4e9c-a4b6-758a8da89db4'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.819272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] The token cache is being invalidate because project 2928e0b68bde468383299b972e36dc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:22:27.819568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.820201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-926c16f8-c55a-4e9c-a4b6-758a8da89db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:27.822334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1175/2356] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:22:27 2022] DELETE /identity/v3/projects/2928e0b68bde468383299b972e36dc83 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:22:27.828250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3d1d-fb8f-403b-aba5-6b3782bbb323 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:27.828714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3d1d-fb8f-403b-aba5-6b3782bbb323 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:27.828816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea3d1d-fb8f-403b-aba5-6b3782bbb323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:27.847548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-eaea3d1d-fb8f-403b-aba5-6b3782bbb323 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:27.848744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-eaea3d1d-fb8f-403b-aba5-6b3782bbb323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:27.861338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:27.906594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1182/2357] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:27.915217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864077d-2852-45bf-9257-17807d19b4ad None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:27.915511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864077d-2852-45bf-9257-17807d19b4ad None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:27.915793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864077d-2852-45bf-9257-17807d19b4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:27.934660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f864077d-2852-45bf-9257-17807d19b4ad None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:27.935862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f864077d-2852-45bf-9257-17807d19b4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:27.944020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1176/2358] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:27.948540 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea3d1d-fb8f-403b-aba5-6b3782bbb323 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:27.958059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea3d1d-fb8f-403b-aba5-6b3782bbb323 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:27.963364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:27.964018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:27.964306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:27.964587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:27.965315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:22:27.965628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:27.967285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:27.978876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1183/2359] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:22:27.982554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864077d-2852-45bf-9257-17807d19b4ad None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:27.991707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864077d-2852-45bf-9257-17807d19b4ad None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:27.996325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036294-ecce-4b9b-a0ac-6283469b5fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:27.996968 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036294-ecce-4b9b-a0ac-6283469b5fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:27.997256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036294-ecce-4b9b-a0ac-6283469b5fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:27.997537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036294-ecce-4b9b-a0ac-6283469b5fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:27.998308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6036294-ecce-4b9b-a0ac-6283469b5fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:28.000243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6036294-ecce-4b9b-a0ac-6283469b5fe0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:28.083902 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1177/2360] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:22:27 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:28.088507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:28.098502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64cb9e-72ee-4020-bb29-5063530e2ec2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:28.154377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592ee9b-b315-48ec-8ac1-3c9fa675e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:28.155035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ee9b-b315-48ec-8ac1-3c9fa675e001 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:28.155342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ee9b-b315-48ec-8ac1-3c9fa675e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:28.155642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ee9b-b315-48ec-8ac1-3c9fa675e001 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:28.156331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592ee9b-b315-48ec-8ac1-3c9fa675e001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:28.158587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592ee9b-b315-48ec-8ac1-3c9fa675e001 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:28.248898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1184/2361] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:22:28 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:22:28.253017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036294-ecce-4b9b-a0ac-6283469b5fe0 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:28.264419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036294-ecce-4b9b-a0ac-6283469b5fe0 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:28.269035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e1d66-ef2a-43a7-a081-da27fe0f7767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:28.269763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e1d66-ef2a-43a7-a081-da27fe0f7767 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:28.270085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e1d66-ef2a-43a7-a081-da27fe0f7767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:28.275322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e1d66-ef2a-43a7-a081-da27fe0f7767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:28.275322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e1d66-ef2a-43a7-a081-da27fe0f7767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:28.275322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e1d66-ef2a-43a7-a081-da27fe0f7767 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:28.283413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1178/2362] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:28.287385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592ee9b-b315-48ec-8ac1-3c9fa675e001 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:28.297416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592ee9b-b315-48ec-8ac1-3c9fa675e001 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:28.302060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18497e-5a7d-450f-a0f7-6f07abaaf9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:28.302722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18497e-5a7d-450f-a0f7-6f07abaaf9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:28.303002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18497e-5a7d-450f-a0f7-6f07abaaf9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:28.303281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18497e-5a7d-450f-a0f7-6f07abaaf9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:28.304034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18497e-5a7d-450f-a0f7-6f07abaaf9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:28.306163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18497e-5a7d-450f-a0f7-6f07abaaf9e1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:28.316197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1185/2363] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:28.320118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e1d66-ef2a-43a7-a081-da27fe0f7767 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:28.330452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e1d66-ef2a-43a7-a081-da27fe0f7767 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:28.335061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:28.335876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:28.336160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:28.336438 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] PATH_INFO: `/v3/projects/7633b4fb9ffd46f48cff6eccd1f0d600/users/a4aac51486794807bf6f2643651c60e3/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:28.351236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7633b4fb9ffd46f48cff6eccd1f0d600, user_id=a4aac51486794807bf6f2643651c60e3, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:28.353912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:28.451237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1179/2364] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:28 2022] PUT /identity/v3/projects/7633b4fb9ffd46f48cff6eccd1f0d600/users/a4aac51486794807bf6f2643651c60e3/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:22:28.462766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ec93d-ab38-48d9-b28e-47dfb2c265ba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:28.463069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ec93d-ab38-48d9-b28e-47dfb2c265ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:28.463358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ec93d-ab38-48d9-b28e-47dfb2c265ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:28.489042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a86ec93d-ab38-48d9-b28e-47dfb2c265ba None None] MFA Rules not processed for user `a4aac51486794807bf6f2643651c60e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:28.490280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a86ec93d-ab38-48d9-b28e-47dfb2c265ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:28.551852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1186/2365] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:28.563358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:28.565038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:28.620370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211682-12aa-4b74-8a9e-562afeb5038d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:28.623905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3293fc3-f0c2-461f-97bd-19428d79fafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:28.624538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3293fc3-f0c2-461f-97bd-19428d79fafe service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:28.624823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3293fc3-f0c2-461f-97bd-19428d79fafe service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:28.625097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3293fc3-f0c2-461f-97bd-19428d79fafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:28.633130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3293fc3-f0c2-461f-97bd-19428d79fafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:28.634615 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3293fc3-f0c2-461f-97bd-19428d79fafe service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:28.643083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1180/2366] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:33.742509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ec93d-ab38-48d9-b28e-47dfb2c265ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:33.759277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:33.805088 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ec93d-ab38-48d9-b28e-47dfb2c265ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:33.809718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:33.812441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:33.812441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:33.812441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] PATH_INFO: `/v3/users/a4aac51486794807bf6f2643651c60e3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:33.812441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4aac51486794807bf6f2643651c60e3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:33.814358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:33.989700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4aac51486794807bf6f2643651c60e3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:33.996454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4aac51486794807bf6f2643651c60e3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.081853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4aac51486794807bf6f2643651c60e3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.082501 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4aac51486794807bf6f2643651c60e3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.083118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4aac51486794807bf6f2643651c60e3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.101029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1187/2367] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:22:33 2022] DELETE /identity/v3/users/a4aac51486794807bf6f2643651c60e3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:34.106073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71d1a-f23c-4555-8fba-0fa49859bb7a None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:34.106545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71d1a-f23c-4555-8fba-0fa49859bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:34.106656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71d1a-f23c-4555-8fba-0fa49859bb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:34.124801 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-a6a71d1a-f23c-4555-8fba-0fa49859bb7a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:34.126100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a6a71d1a-f23c-4555-8fba-0fa49859bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:34.151067 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:34.187699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1181/2368] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:34.197405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:34.198956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:34.257367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c43c8-b756-4cd4-8755-d94427bca2b1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:34.261473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845446-7341-4485-8cd8-cbc39d49bd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:34.262154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845446-7341-4485-8cd8-cbc39d49bd9f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:34.262445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845446-7341-4485-8cd8-cbc39d49bd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:34.262724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845446-7341-4485-8cd8-cbc39d49bd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:34.271930 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845446-7341-4485-8cd8-cbc39d49bd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:34.273604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66845446-7341-4485-8cd8-cbc39d49bd9f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:34.283990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1188/2369] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:34.659005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71d1a-f23c-4555-8fba-0fa49859bb7a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:34.661058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a6a71d1a-f23c-4555-8fba-0fa49859bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:34.672052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71d1a-f23c-4555-8fba-0fa49859bb7a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:34.677059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:34.677948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:34.678268 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:34.678528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] PATH_INFO: `/v3/projects/7633b4fb9ffd46f48cff6eccd1f0d600` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:34.679731 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7633b4fb9ffd46f48cff6eccd1f0d600)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:34.681678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:34.812777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7633b4fb9ffd46f48cff6eccd1f0d600', 'request_id': 'req-945fab6a-c015-4a63-bb6c-17b09b19231f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.819369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7633b4fb9ffd46f48cff6eccd1f0d600', 'request_id': 'req-945fab6a-c015-4a63-bb6c-17b09b19231f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.907917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7633b4fb9ffd46f48cff6eccd1f0d600', 'request_id': 'req-945fab6a-c015-4a63-bb6c-17b09b19231f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.918778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] The token cache is being invalidate because project 7633b4fb9ffd46f48cff6eccd1f0d600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:22:34.919070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.919697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-945fab6a-c015-4a63-bb6c-17b09b19231f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:22:34.921331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1182/2370] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:22:34 2022] DELETE /identity/v3/projects/7633b4fb9ffd46f48cff6eccd1f0d600 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:22:34.926300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2efd3-1f58-415d-b1cf-95da60606a37 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:34.926797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2efd3-1f58-415d-b1cf-95da60606a37 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:34.926892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2efd3-1f58-415d-b1cf-95da60606a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:34.944705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-16d2efd3-1f58-415d-b1cf-95da60606a37 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:34.945932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-16d2efd3-1f58-415d-b1cf-95da60606a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:34.978911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:35.005242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1189/2371] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:22:35.014774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0111d-e02b-498e-8b8b-be35cbe22af6 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.015214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0111d-e02b-498e-8b8b-be35cbe22af6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.015462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0111d-e02b-498e-8b8b-be35cbe22af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.033709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c9d0111d-e02b-498e-8b8b-be35cbe22af6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:35.035060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c9d0111d-e02b-498e-8b8b-be35cbe22af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:35.042935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1183/2372] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:35.046999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2efd3-1f58-415d-b1cf-95da60606a37 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:35.057060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2efd3-1f58-415d-b1cf-95da60606a37 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:35.061669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:35.062315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.062603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.062881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.063625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:22:35.063915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:35.065554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:35.077419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1190/2373] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:22:35.082886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0111d-e02b-498e-8b8b-be35cbe22af6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:35.092073 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0111d-e02b-498e-8b8b-be35cbe22af6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:35.096920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184199d-9e73-4355-9325-5238a6c59cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:35.097578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184199d-9e73-4355-9325-5238a6c59cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.097953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184199d-9e73-4355-9325-5238a6c59cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.098255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184199d-9e73-4355-9325-5238a6c59cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.098989 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184199d-9e73-4355-9325-5238a6c59cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:35.100920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184199d-9e73-4355-9325-5238a6c59cd1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:35.221316 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1184/2374] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:22:35 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:22:35.225600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:35.235904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2c876-5f97-40da-82ec-03a42b8cab7f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:35.294470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9300663-83e4-415b-ba13-8bea7c36930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:35.295070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9300663-83e4-415b-ba13-8bea7c36930f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.295357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9300663-83e4-415b-ba13-8bea7c36930f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.295637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9300663-83e4-415b-ba13-8bea7c36930f admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.296315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9300663-83e4-415b-ba13-8bea7c36930f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:35.298294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9300663-83e4-415b-ba13-8bea7c36930f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:35.396307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1191/2375] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:22:35 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:22:35.400898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184199d-9e73-4355-9325-5238a6c59cd1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:35.411654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184199d-9e73-4355-9325-5238a6c59cd1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:35.416247 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4028-7f9b-4a6a-af08-257347f52360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:35.416912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4028-7f9b-4a6a-af08-257347f52360 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.417201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4028-7f9b-4a6a-af08-257347f52360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.417529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4028-7f9b-4a6a-af08-257347f52360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.418299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff4028-7f9b-4a6a-af08-257347f52360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:35.419910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff4028-7f9b-4a6a-af08-257347f52360 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:35.430529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1185/2376] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:35.434565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9300663-83e4-415b-ba13-8bea7c36930f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:35.444346 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9300663-83e4-415b-ba13-8bea7c36930f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:35.449362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98ce54-bf6d-4f6e-8813-c56a1f2654aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:35.450037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ce54-bf6d-4f6e-8813-c56a1f2654aa admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.450323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ce54-bf6d-4f6e-8813-c56a1f2654aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.450597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ce54-bf6d-4f6e-8813-c56a1f2654aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.451310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98ce54-bf6d-4f6e-8813-c56a1f2654aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:35.452892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98ce54-bf6d-4f6e-8813-c56a1f2654aa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:35.463138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1192/2377] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:22:35.467006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4028-7f9b-4a6a-af08-257347f52360 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:35.476860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4028-7f9b-4a6a-af08-257347f52360 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:35.481453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:35.482357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.482645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.482922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] PATH_INFO: `/v3/projects/12159c6ed8a2430f9cc56edb10852add/users/2540f03eb616429e98a1427f5999410a/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.498240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12159c6ed8a2430f9cc56edb10852add, user_id=2540f03eb616429e98a1427f5999410a, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:35.501231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:35.590702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1186/2378] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:22:35 2022] PUT /identity/v3/projects/12159c6ed8a2430f9cc56edb10852add/users/2540f03eb616429e98a1427f5999410a/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:22:35.595771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47764188-f0b9-4d25-8802-990f095a0515 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.600427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47764188-f0b9-4d25-8802-990f095a0515 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.600427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47764188-f0b9-4d25-8802-990f095a0515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.614252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-47764188-f0b9-4d25-8802-990f095a0515 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:35.615429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-47764188-f0b9-4d25-8802-990f095a0515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:35.674662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1193/2379] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:35.684749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:35.686482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:35.739853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:35.743970 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa116b-107d-4778-8ae8-65da291c4e28 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:35.747653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:35.749292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:35.749292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:35.749292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:35.758556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:35.759984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:35.769433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1187/2380] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:37.117535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55984d60-9932-45a9-b51c-69f45bc31614 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:37.118617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55984d60-9932-45a9-b51c-69f45bc31614 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:37.120584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55984d60-9932-45a9-b51c-69f45bc31614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:37.151790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-55984d60-9932-45a9-b51c-69f45bc31614 None None] MFA Rules not processed for user `2540f03eb616429e98a1427f5999410a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:37.153012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-55984d60-9932-45a9-b51c-69f45bc31614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:37.187199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:37.222410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1194/2381] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:37.233547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:22:37.234945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:37.291950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2298d1-d57c-45fb-9329-541e576bd730 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:22:37.295882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb47a0-bc49-4e9e-938c-79bdfc80f0bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:22:37.296571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb47a0-bc49-4e9e-938c-79bdfc80f0bb service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:37.296857 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb47a0-bc49-4e9e-938c-79bdfc80f0bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:37.297133 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb47a0-bc49-4e9e-938c-79bdfc80f0bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:37.305376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb47a0-bc49-4e9e-938c-79bdfc80f0bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:22:37.307448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb47a0-bc49-4e9e-938c-79bdfc80f0bb service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:22:37.315716 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1188/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:22:38.997719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056ab7-473e-44cd-abc6-70cc6c4ee00e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:38.998265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056ab7-473e-44cd-abc6-70cc6c4ee00e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:38.998364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19056ab7-473e-44cd-abc6-70cc6c4ee00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:39.017810 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-19056ab7-473e-44cd-abc6-70cc6c4ee00e None None] MFA Rules not processed for user `2540f03eb616429e98a1427f5999410a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:39.018990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-19056ab7-473e-44cd-abc6-70cc6c4ee00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:39.025821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1195/2383] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:47.311753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=30 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:47.829504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20350a-1d20-4398-8943-e8e1138b21c1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:22:47.829805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20350a-1d20-4398-8943-e8e1138b21c1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:22:47.832382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20350a-1d20-4398-8943-e8e1138b21c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:22:47.847733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5f20350a-1d20-4398-8943-e8e1138b21c1 None None] MFA Rules not processed for user `8d419d0520ed48b181dc528aff6364fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:22:47.848914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5f20350a-1d20-4398-8943-e8e1138b21c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:22:47.903526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1189/2384] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:22:49.011183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=15 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:22:57.896951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=25 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:02.132160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d3718-ac33-478c-9049-d25378a81630 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:02.132672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d3718-ac33-478c-9049-d25378a81630 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:02.132798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d3718-ac33-478c-9049-d25378a81630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:02.151513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c48d3718-ac33-478c-9049-d25378a81630 None None] MFA Rules not processed for user `2540f03eb616429e98a1427f5999410a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:02.152724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c48d3718-ac33-478c-9049-d25378a81630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:02.159760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1196/2385] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:12.145138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:14.768229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a4ad5-2a4c-4e29-b4f2-3735fa14d85d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:14.768711 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a4ad5-2a4c-4e29-b4f2-3735fa14d85d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:14.768826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a4ad5-2a4c-4e29-b4f2-3735fa14d85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:14.787984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-389a4ad5-2a4c-4e29-b4f2-3735fa14d85d None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:14.789780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-389a4ad5-2a4c-4e29-b4f2-3735fa14d85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:14.850629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1190/2386] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:14.986416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d3718-ac33-478c-9049-d25378a81630 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:14.987847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c48d3718-ac33-478c-9049-d25378a81630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:15.060319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d3718-ac33-478c-9049-d25378a81630 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:15.065342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc5e5-6724-4c8a-9b23-14b1ac345ae6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:15.066019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc5e5-6724-4c8a-9b23-14b1ac345ae6 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:15.070529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc5e5-6724-4c8a-9b23-14b1ac345ae6 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:15.070529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc5e5-6724-4c8a-9b23-14b1ac345ae6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:15.075154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc5e5-6724-4c8a-9b23-14b1ac345ae6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:15.076781 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc5e5-6724-4c8a-9b23-14b1ac345ae6 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:15.084671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1197/2387] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:23:24.844892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=25 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:25.081457 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=32 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:28.427497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c296-1435-4293-ac57-fccafb30e79d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:28.432537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c296-1435-4293-ac57-fccafb30e79d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:28.432537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c296-1435-4293-ac57-fccafb30e79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:28.447185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f5c7c296-1435-4293-ac57-fccafb30e79d None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:28.448432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f5c7c296-1435-4293-ac57-fccafb30e79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:28.455895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1191/2388] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:28.467702 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc5e5-6724-4c8a-9b23-14b1ac345ae6 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:28.479522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc5e5-6724-4c8a-9b23-14b1ac345ae6 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:28.484853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bb745-8c0e-4ac9-b9b7-db46ab59995a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:28.485504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb745-8c0e-4ac9-b9b7-db46ab59995a service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:28.486162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb745-8c0e-4ac9-b9b7-db46ab59995a service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:28.486645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb745-8c0e-4ac9-b9b7-db46ab59995a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:28.496238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bb745-8c0e-4ac9-b9b7-db46ab59995a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:28.498037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bb745-8c0e-4ac9-b9b7-db46ab59995a service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:28.507204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1198/2389] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:23:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:23:34.952549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13935-a3b7-46d8-ac89-21c8e101bea3 None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:34.953449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13935-a3b7-46d8-ac89-21c8e101bea3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:34.953920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13935-a3b7-46d8-ac89-21c8e101bea3 None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:34.955597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1192/2390] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:23:34.962457 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0201-4769-4878-a146-6a01f554f76a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:34.963013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0201-4769-4878-a146-6a01f554f76a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:34.963106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0201-4769-4878-a146-6a01f554f76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:34.985303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f92b0201-4769-4878-a146-6a01f554f76a None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:34.987228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f92b0201-4769-4878-a146-6a01f554f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:35.067861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1199/2391] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:35.080936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc13935-a3b7-46d8-ac89-21c8e101bea3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:35.083344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9dc13935-a3b7-46d8-ac89-21c8e101bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:35.151752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc13935-a3b7-46d8-ac89-21c8e101bea3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:35.155798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5aed0-f35f-43a4-8f76-2de99d3960b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca08d82f02a24e0088aceff2b6ba307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:35.156704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5aed0-f35f-43a4-8f76-2de99d3960b1 service glance] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:35.156994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5aed0-f35f-43a4-8f76-2de99d3960b1 service glance] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:35.157289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5aed0-f35f-43a4-8f76-2de99d3960b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:35.169267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5aed0-f35f-43a4-8f76-2de99d3960b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:35.170769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5aed0-f35f-43a4-8f76-2de99d3960b1 service glance] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:35.182926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1193/2392] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:23:35.409701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747d92c-6369-466b-b30d-fec57918da45 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:35.410363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747d92c-6369-466b-b30d-fec57918da45 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:35.410711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747d92c-6369-466b-b30d-fec57918da45 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:35.412438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1200/2393] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:23:35.418213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c27fc-59e2-4f77-92b2-f3948880a9e0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:35.418514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c27fc-59e2-4f77-92b2-f3948880a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:35.418802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c27fc-59e2-4f77-92b2-f3948880a9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:35.443026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-eb5c27fc-59e2-4f77-92b2-f3948880a9e0 None None] MFA Rules not processed for user `35763651d4614bf68400b5efce4113a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:35.444253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-eb5c27fc-59e2-4f77-92b2-f3948880a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:35.451549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1194/2394] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:35.463782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747d92c-6369-466b-b30d-fec57918da45 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:35.475806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747d92c-6369-466b-b30d-fec57918da45 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:35.480121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc136-f8d7-4030-b10b-1261ce4f71fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:35.480956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc136-f8d7-4030-b10b-1261ce4f71fa service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:35.481361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc136-f8d7-4030-b10b-1261ce4f71fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:35.481644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc136-f8d7-4030-b10b-1261ce4f71fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:35.492370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dc136-f8d7-4030-b10b-1261ce4f71fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:35.492370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dc136-f8d7-4030-b10b-1261ce4f71fa service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:35.501752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1201/2395] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:23:35.611403 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbab3f-31a5-4c0a-adf7-c0ea38c2974a None None] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:35.611706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbab3f-31a5-4c0a-adf7-c0ea38c2974a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:35.611995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbab3f-31a5-4c0a-adf7-c0ea38c2974a None None] PATH_INFO: `/` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:35.613578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1195/2396] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 30 12:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 30 12:23:35.619315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed889f-a554-443d-8b16-96ff3b1c1707 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:35.619831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed889f-a554-443d-8b16-96ff3b1c1707 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:35.620273 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed889f-a554-443d-8b16-96ff3b1c1707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:35.642578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-89ed889f-a554-443d-8b16-96ff3b1c1707 None None] MFA Rules not processed for user `7ca17dc23a924e41a657db3122445923`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:35.643899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-89ed889f-a554-443d-8b16-96ff3b1c1707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:35.654849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1202/2397] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 30 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:35.667365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbab3f-31a5-4c0a-adf7-c0ea38c2974a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:35.680038 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbab3f-31a5-4c0a-adf7-c0ea38c2974a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:35.685763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cba70-3855-4bb3-87e7-b883facf3e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:35.686678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cba70-3855-4bb3-87e7-b883facf3e4e service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:35.687138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cba70-3855-4bb3-87e7-b883facf3e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:35.687563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cba70-3855-4bb3-87e7-b883facf3e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:35.699740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cba70-3855-4bb3-87e7-b883facf3e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:35.701570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cba70-3855-4bb3-87e7-b883facf3e4e service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:35.716534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1196/2398] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:23:36.676093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed889f-a554-443d-8b16-96ff3b1c1707 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:36.679008 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-89ed889f-a554-443d-8b16-96ff3b1c1707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:36.770695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed889f-a554-443d-8b16-96ff3b1c1707 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:36.775855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:36.776509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:36.776798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:36.777081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:36.778961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:36.791629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:36.793243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:36.805079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1203/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:23:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:23:38.952126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d3302-0677-431d-8f0e-6b1a8786859e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:38.952636 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d3302-0677-431d-8f0e-6b1a8786859e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:38.952758 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d3302-0677-431d-8f0e-6b1a8786859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:38.978493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-a60d3302-0677-431d-8f0e-6b1a8786859e None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:38.980453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a60d3302-0677-431d-8f0e-6b1a8786859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:38.994739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1197/2400] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:39.004639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:39.017335 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fad04-8d10-45f6-800a-5da4eee872e8 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:39.023562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30c5fd-d4a4-4e64-9e7e-0796332411bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:39.024474 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c5fd-d4a4-4e64-9e7e-0796332411bc service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:39.024984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c5fd-d4a4-4e64-9e7e-0796332411bc service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:39.025472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c5fd-d4a4-4e64-9e7e-0796332411bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:39.034896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30c5fd-d4a4-4e64-9e7e-0796332411bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:39.036617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30c5fd-d4a4-4e64-9e7e-0796332411bc service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:39.048699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1204/2401] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:23:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:23:46.347630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63b61d-b7a4-4289-9c31-609930572aaf None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:46.348169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63b61d-b7a4-4289-9c31-609930572aaf None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:46.348169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63b61d-b7a4-4289-9c31-609930572aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:46.367113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9e63b61d-b7a4-4289-9c31-609930572aaf None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:46.368343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9e63b61d-b7a4-4289-9c31-609930572aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:46.376114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1198/2402] 10.222.0.48 () {58 vars in 967 bytes} [Mon May 30 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:46.396252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30c5fd-d4a4-4e64-9e7e-0796332411bc service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:46.407745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30c5fd-d4a4-4e64-9e7e-0796332411bc service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:46.413001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd8911-bdad-46fe-b34f-2beedac1657c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:46.414281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd8911-bdad-46fe-b34f-2beedac1657c service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:46.414513 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd8911-bdad-46fe-b34f-2beedac1657c service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:46.414939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd8911-bdad-46fe-b34f-2beedac1657c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:46.424186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd8911-bdad-46fe-b34f-2beedac1657c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:46.426163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd8911-bdad-46fe-b34f-2beedac1657c service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:46.436018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1205/2403] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:23:50.039144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63b61d-b7a4-4289-9c31-609930572aaf None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:50.041485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9e63b61d-b7a4-4289-9c31-609930572aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:50.057700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63b61d-b7a4-4289-9c31-609930572aaf None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:50.067770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:50.068476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:50.068812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:50.069099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:50.071687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:50.083618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:50.086047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:50.095693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1199/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:23:50.172908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd8911-bdad-46fe-b34f-2beedac1657c service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:50.185493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd8911-bdad-46fe-b34f-2beedac1657c service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:50.190422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:50.191292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:50.191578 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:50.191892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] PATH_INFO: `/v3/users/2540f03eb616429e98a1427f5999410a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:50.193081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2540f03eb616429e98a1427f5999410a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:50.195857 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:50.213306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:50.441537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2540f03eb616429e98a1427f5999410a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:50.449357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2540f03eb616429e98a1427f5999410a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:50.592738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2540f03eb616429e98a1427f5999410a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:50.593465 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2540f03eb616429e98a1427f5999410a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:50.594111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-022cb674-d050-4644-92b2-29e1ed060a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2540f03eb616429e98a1427f5999410a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:50.612638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1206/2405] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:23:50 2022] DELETE /identity/v3/users/2540f03eb616429e98a1427f5999410a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:23:50.872420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:50.883451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233dd4e-b28a-46bb-b2af-cb83be725c90 service placement] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:50.943861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:50.945170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:50.945170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:50.945359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] PATH_INFO: `/v3/projects/12159c6ed8a2430f9cc56edb10852add` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:50.946511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12159c6ed8a2430f9cc56edb10852add)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:50.948497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:51.067706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12159c6ed8a2430f9cc56edb10852add', 'request_id': 'req-718f47e4-d065-477c-8dcc-7b29d3e57467'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:51.069632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:51.074377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12159c6ed8a2430f9cc56edb10852add', 'request_id': 'req-718f47e4-d065-477c-8dcc-7b29d3e57467'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:51.144218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12159c6ed8a2430f9cc56edb10852add', 'request_id': 'req-718f47e4-d065-477c-8dcc-7b29d3e57467'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:51.156155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] The token cache is being invalidate because project 12159c6ed8a2430f9cc56edb10852add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:23:51.156448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:51.157098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-718f47e4-d065-477c-8dcc-7b29d3e57467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:51.158671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1200/2406] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:23:50 2022] DELETE /identity/v3/projects/12159c6ed8a2430f9cc56edb10852add => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:23:51.165106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92012-89d4-4ec2-bf5c-926dfffb6302 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.165459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92012-89d4-4ec2-bf5c-926dfffb6302 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.165748 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c92012-89d4-4ec2-bf5c-926dfffb6302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.183197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-25c92012-89d4-4ec2-bf5c-926dfffb6302 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:51.184390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-25c92012-89d4-4ec2-bf5c-926dfffb6302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:51.242699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1207/2407] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:23:51.250325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470758ee-45a4-4add-9d2e-4c04ce579b2c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.250565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470758ee-45a4-4add-9d2e-4c04ce579b2c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.250853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470758ee-45a4-4add-9d2e-4c04ce579b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.269009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-470758ee-45a4-4add-9d2e-4c04ce579b2c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:51.270242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-470758ee-45a4-4add-9d2e-4c04ce579b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:51.279056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1201/2408] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:51.283603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c92012-89d4-4ec2-bf5c-926dfffb6302 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:51.293702 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c92012-89d4-4ec2-bf5c-926dfffb6302 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:51.298286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:51.298938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.299229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.299509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.300231 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:23:51.300543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:51.302196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:51.313497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1208/2409] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:23:51.317482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470758ee-45a4-4add-9d2e-4c04ce579b2c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:51.326511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470758ee-45a4-4add-9d2e-4c04ce579b2c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:51.331056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7384d-9439-45b3-908c-cfba18ae6266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:51.331689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7384d-9439-45b3-908c-cfba18ae6266 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.331988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7384d-9439-45b3-908c-cfba18ae6266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.332244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7384d-9439-45b3-908c-cfba18ae6266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.332959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7384d-9439-45b3-908c-cfba18ae6266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:51.335459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7384d-9439-45b3-908c-cfba18ae6266 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:51.427803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1202/2410] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:23:51 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:23:51.431874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:51.441676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe9f9d-d145-4842-874f-45498d4f58b2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:51.496598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e657-465f-49a0-a95c-3a7cad9f12cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:51.497260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e657-465f-49a0-a95c-3a7cad9f12cd admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.497547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e657-465f-49a0-a95c-3a7cad9f12cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.497822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e657-465f-49a0-a95c-3a7cad9f12cd admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.498532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e657-465f-49a0-a95c-3a7cad9f12cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:51.500528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e657-465f-49a0-a95c-3a7cad9f12cd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:51.603566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1209/2411] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:23:51 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:23:51.607749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7384d-9439-45b3-908c-cfba18ae6266 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:51.618067 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7384d-9439-45b3-908c-cfba18ae6266 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:51.623526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62956e97-1f0f-4a5b-baac-0ffe1f58bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:51.624185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956e97-1f0f-4a5b-baac-0ffe1f58bb01 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.624477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956e97-1f0f-4a5b-baac-0ffe1f58bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.624762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956e97-1f0f-4a5b-baac-0ffe1f58bb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.625530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62956e97-1f0f-4a5b-baac-0ffe1f58bb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:51.627177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62956e97-1f0f-4a5b-baac-0ffe1f58bb01 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:51.638006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1203/2412] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:23:51.641693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e657-465f-49a0-a95c-3a7cad9f12cd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:51.652170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e657-465f-49a0-a95c-3a7cad9f12cd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:51.656897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8424de-933b-4886-bee7-8301a20c8605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:51.657542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8424de-933b-4886-bee7-8301a20c8605 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.657826 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8424de-933b-4886-bee7-8301a20c8605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.658142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8424de-933b-4886-bee7-8301a20c8605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.658865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8424de-933b-4886-bee7-8301a20c8605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:51.660452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8424de-933b-4886-bee7-8301a20c8605 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:51.665552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:51.671080 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1210/2413] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:23:51.674933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62956e97-1f0f-4a5b-baac-0ffe1f58bb01 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:51.684861 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62956e97-1f0f-4a5b-baac-0ffe1f58bb01 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:51.689561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:51.690594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.693186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.693186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] PATH_INFO: `/v3/projects/27bb17b940744cf9adba102ac0bd8757/users/c423366b6b124d08bc67917749451bb3/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.705907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27bb17b940744cf9adba102ac0bd8757, user_id=c423366b6b124d08bc67917749451bb3, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:51.708612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:51.815652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1204/2414] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:23:51 2022] PUT /identity/v3/projects/27bb17b940744cf9adba102ac0bd8757/users/c423366b6b124d08bc67917749451bb3/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:23:51.877879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548ef5-4e4a-4185-8bc2-2924bd6d0bc5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:51.878215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548ef5-4e4a-4185-8bc2-2924bd6d0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:51.878532 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548ef5-4e4a-4185-8bc2-2924bd6d0bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:51.905013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3f548ef5-4e4a-4185-8bc2-2924bd6d0bc5 None None] MFA Rules not processed for user `c423366b6b124d08bc67917749451bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:51.906501 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3f548ef5-4e4a-4185-8bc2-2924bd6d0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:51.969542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1211/2415] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:51.980841 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:51.982537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:52.041583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b49ec0-276d-47ab-9ed3-680d34df2547 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:52.045409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e21f3-03e4-40e2-aaf1-1e7c59018254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:52.046164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e21f3-03e4-40e2-aaf1-1e7c59018254 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:52.046451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e21f3-03e4-40e2-aaf1-1e7c59018254 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:52.046725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e21f3-03e4-40e2-aaf1-1e7c59018254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:52.055681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e21f3-03e4-40e2-aaf1-1e7c59018254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:52.057118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e21f3-03e4-40e2-aaf1-1e7c59018254 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:52.066467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1205/2416] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:23:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:23:56.096573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548ef5-4e4a-4185-8bc2-2924bd6d0bc5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:56.159367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548ef5-4e4a-4185-8bc2-2924bd6d0bc5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:56.163872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:56.164735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:56.165019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:56.165292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] PATH_INFO: `/v3/users/c423366b6b124d08bc67917749451bb3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:56.166500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c423366b6b124d08bc67917749451bb3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:56.171007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:56.329320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c423366b6b124d08bc67917749451bb3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:56.336608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c423366b6b124d08bc67917749451bb3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:56.400994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c423366b6b124d08bc67917749451bb3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:56.401628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c423366b6b124d08bc67917749451bb3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:56.402256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c423366b6b124d08bc67917749451bb3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:56.419560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1212/2417] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:23:56 2022] DELETE /identity/v3/users/c423366b6b124d08bc67917749451bb3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:23:56.423999 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062bfa-0c50-446a-8307-9e5c058008be None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:56.424501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062bfa-0c50-446a-8307-9e5c058008be None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:56.424601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062bfa-0c50-446a-8307-9e5c058008be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:56.441648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-df062bfa-0c50-446a-8307-9e5c058008be None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:56.442867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-df062bfa-0c50-446a-8307-9e5c058008be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:56.500885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1206/2418] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:56.510921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:56.512320 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:56.523022 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:56.568822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9574-56f6-4a95-a698-e56fa739e871 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:56.573544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3f2a2-c1f2-40a0-b12a-80db466a0d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:56.574233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f2a2-c1f2-40a0-b12a-80db466a0d49 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:56.574525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f2a2-c1f2-40a0-b12a-80db466a0d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:56.574806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f2a2-c1f2-40a0-b12a-80db466a0d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:56.584220 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3f2a2-c1f2-40a0-b12a-80db466a0d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:56.585734 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3f2a2-c1f2-40a0-b12a-80db466a0d49 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:56.595601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1213/2419] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:23:57.036980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df062bfa-0c50-446a-8307-9e5c058008be None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:57.039132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-df062bfa-0c50-446a-8307-9e5c058008be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:57.051259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df062bfa-0c50-446a-8307-9e5c058008be None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:57.056909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:57.057788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.058091 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.058371 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] PATH_INFO: `/v3/projects/27bb17b940744cf9adba102ac0bd8757` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.060557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27bb17b940744cf9adba102ac0bd8757)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:57.061899 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:57.079844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:57.170600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27bb17b940744cf9adba102ac0bd8757', 'request_id': 'req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:57.176830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27bb17b940744cf9adba102ac0bd8757', 'request_id': 'req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:57.255510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27bb17b940744cf9adba102ac0bd8757', 'request_id': 'req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:57.267164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] The token cache is being invalidate because project 27bb17b940744cf9adba102ac0bd8757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:23:57.267451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:57.268071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a549e9a2-1cdd-4c56-8212-1fc038f75e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:23:57.269694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1207/2420] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:23:57 2022] DELETE /identity/v3/projects/27bb17b940744cf9adba102ac0bd8757 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:23:57.275264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f67f5-069d-42a2-b88b-0a84a9d74b7a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.275740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f67f5-069d-42a2-b88b-0a84a9d74b7a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.275850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f67f5-069d-42a2-b88b-0a84a9d74b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.295314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7e1f67f5-069d-42a2-b88b-0a84a9d74b7a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:57.296553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7e1f67f5-069d-42a2-b88b-0a84a9d74b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:57.355284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1214/2421] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:57.363207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fc02-3700-4082-b53c-d3ca737664d4 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.363501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fc02-3700-4082-b53c-d3ca737664d4 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.363784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fc02-3700-4082-b53c-d3ca737664d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.381883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ca45fc02-3700-4082-b53c-d3ca737664d4 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:57.383119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ca45fc02-3700-4082-b53c-d3ca737664d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:57.391065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1208/2422] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:57.395269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f67f5-069d-42a2-b88b-0a84a9d74b7a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:57.405462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f67f5-069d-42a2-b88b-0a84a9d74b7a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:57.410413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:57.413261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.413261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.413261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.413261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:23:57.413261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:57.414918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:57.426483 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1215/2423] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:23:57.430611 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fc02-3700-4082-b53c-d3ca737664d4 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:57.439633 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fc02-3700-4082-b53c-d3ca737664d4 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:57.444271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b66bc-60cb-45ef-afbf-636c9c956eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:57.445407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b66bc-60cb-45ef-afbf-636c9c956eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.445691 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b66bc-60cb-45ef-afbf-636c9c956eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.445985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b66bc-60cb-45ef-afbf-636c9c956eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.446700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b66bc-60cb-45ef-afbf-636c9c956eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:57.448616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b66bc-60cb-45ef-afbf-636c9c956eb5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:57.537029 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1209/2424] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:23:57 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:23:57.541169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:57.551200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b309f-6db4-47f0-ad7f-d55cb8964003 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:57.610078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966462c-e6e7-4c72-91d6-0643ce584907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:57.610757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966462c-e6e7-4c72-91d6-0643ce584907 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.611039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966462c-e6e7-4c72-91d6-0643ce584907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.611315 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966462c-e6e7-4c72-91d6-0643ce584907 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.612007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966462c-e6e7-4c72-91d6-0643ce584907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:57.614240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966462c-e6e7-4c72-91d6-0643ce584907 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:57.739084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1216/2425] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:23:57 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:23:57.743190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b66bc-60cb-45ef-afbf-636c9c956eb5 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:57.753389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b66bc-60cb-45ef-afbf-636c9c956eb5 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:57.758497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e4549-82e9-4c78-91aa-e3d289028835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:57.759152 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e4549-82e9-4c78-91aa-e3d289028835 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.759433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e4549-82e9-4c78-91aa-e3d289028835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.759810 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e4549-82e9-4c78-91aa-e3d289028835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.760625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e4549-82e9-4c78-91aa-e3d289028835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:57.762265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e4549-82e9-4c78-91aa-e3d289028835 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:57.775391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1210/2426] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:23:57.782668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966462c-e6e7-4c72-91d6-0643ce584907 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:57.794199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966462c-e6e7-4c72-91d6-0643ce584907 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:57.799014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2433016-b1fc-4f8d-b1e6-b8df9a612547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:57.799879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2433016-b1fc-4f8d-b1e6-b8df9a612547 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.800009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2433016-b1fc-4f8d-b1e6-b8df9a612547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.800293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2433016-b1fc-4f8d-b1e6-b8df9a612547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.801035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2433016-b1fc-4f8d-b1e6-b8df9a612547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:57.802715 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2433016-b1fc-4f8d-b1e6-b8df9a612547 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:57.812720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1217/2427] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:23:57.817097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e4549-82e9-4c78-91aa-e3d289028835 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:57.827613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e4549-82e9-4c78-91aa-e3d289028835 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:57.832151 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:57.833074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.833355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.833631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] PATH_INFO: `/v3/projects/0593d4f44b9840f2bd338c5f4bf0795c/users/cca4d3e33dfa4915a31f65b824c1fc20/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:57.849631 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0593d4f44b9840f2bd338c5f4bf0795c, user_id=cca4d3e33dfa4915a31f65b824c1fc20, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:57.852461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:57.953512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1211/2428] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:23:57 2022] PUT /identity/v3/projects/0593d4f44b9840f2bd338c5f4bf0795c/users/cca4d3e33dfa4915a31f65b824c1fc20/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:23:57.964059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c416ee-57a7-4fbe-9d88-8ca19bb6cbba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:57.964355 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c416ee-57a7-4fbe-9d88-8ca19bb6cbba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:57.964637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c416ee-57a7-4fbe-9d88-8ca19bb6cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:58.011508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-40c416ee-57a7-4fbe-9d88-8ca19bb6cbba None None] MFA Rules not processed for user `cca4d3e33dfa4915a31f65b824c1fc20`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:23:58.013139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-40c416ee-57a7-4fbe-9d88-8ca19bb6cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:58.020985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:23:58.082304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1218/2429] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:23:58.093724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:23:58.095642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:23:58.152515 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81458295-de0a-42a7-bf5d-8ced121ef33d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:23:58.156496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:23:58.157141 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:23:58.157427 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:23:58.157703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:23:58.166933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:23:58.168482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:23:58.177940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1212/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:02.359934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048ca8-4ca5-440b-a079-87a4606b5d94 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:02.360407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048ca8-4ca5-440b-a079-87a4606b5d94 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:02.360535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91048ca8-4ca5-440b-a079-87a4606b5d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:02.378872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-91048ca8-4ca5-440b-a079-87a4606b5d94 None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:02.380157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-91048ca8-4ca5-440b-a079-87a4606b5d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:02.438157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1219/2431] 10.222.0.48 () {58 vars in 967 bytes} [Mon May 30 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:02.450850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:02.452295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:02.500196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:02.525928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6742-c546-4d46-b068-13c8e150fdfb service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:02.531334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7125abc-66be-4a11-86b0-0bc2ed4eeaec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:02.532016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7125abc-66be-4a11-86b0-0bc2ed4eeaec service swift] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:02.532305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7125abc-66be-4a11-86b0-0bc2ed4eeaec service swift] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:02.532588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7125abc-66be-4a11-86b0-0bc2ed4eeaec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:02.542006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7125abc-66be-4a11-86b0-0bc2ed4eeaec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:02.545676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7125abc-66be-4a11-86b0-0bc2ed4eeaec service swift] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:02.551578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1213/2432] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:24:04.291937 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91048ca8-4ca5-440b-a079-87a4606b5d94 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:04.354971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91048ca8-4ca5-440b-a079-87a4606b5d94 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:04.359473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:04.360372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:04.360675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:04.360935 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] PATH_INFO: `/v3/users/cca4d3e33dfa4915a31f65b824c1fc20` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:04.362184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca4d3e33dfa4915a31f65b824c1fc20)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:04.364138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:04.543021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca4d3e33dfa4915a31f65b824c1fc20'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:04.548181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:04.550279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca4d3e33dfa4915a31f65b824c1fc20'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:04.643401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca4d3e33dfa4915a31f65b824c1fc20'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:04.644046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca4d3e33dfa4915a31f65b824c1fc20'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:04.644657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca4d3e33dfa4915a31f65b824c1fc20'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:04.662390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1220/2433] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:24:04 2022] DELETE /identity/v3/users/cca4d3e33dfa4915a31f65b824c1fc20 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:04.667478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b899b1-27ee-45a9-b9da-b71a42d91499 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:04.667948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b899b1-27ee-45a9-b9da-b71a42d91499 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:04.668057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b899b1-27ee-45a9-b9da-b71a42d91499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:04.685851 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-31b899b1-27ee-45a9-b9da-b71a42d91499 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:04.687246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-31b899b1-27ee-45a9-b9da-b71a42d91499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:04.745726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1214/2434] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:04.755325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:04.756747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:04.825033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428da347-29d7-4c29-8d4e-f4df83697715 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:04.828792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f2c35-7afa-4483-a90b-dbdbb29a6547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:04.829445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2c35-7afa-4483-a90b-dbdbb29a6547 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:04.829731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2c35-7afa-4483-a90b-dbdbb29a6547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:04.830043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2c35-7afa-4483-a90b-dbdbb29a6547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:04.839287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f2c35-7afa-4483-a90b-dbdbb29a6547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:04.840779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f2c35-7afa-4483-a90b-dbdbb29a6547 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:04.850384 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1221/2435] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:05.265877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b899b1-27ee-45a9-b9da-b71a42d91499 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:05.267452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-31b899b1-27ee-45a9-b9da-b71a42d91499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:05.282374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b899b1-27ee-45a9-b9da-b71a42d91499 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:05.287491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:05.288421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:05.288830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:05.289893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] PATH_INFO: `/v3/projects/0593d4f44b9840f2bd338c5f4bf0795c` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:05.291226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0593d4f44b9840f2bd338c5f4bf0795c)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:05.293798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:05.425437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0593d4f44b9840f2bd338c5f4bf0795c', 'request_id': 'req-80e66df9-3a6f-4712-a539-864ff2d91ed2'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:05.432309 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0593d4f44b9840f2bd338c5f4bf0795c', 'request_id': 'req-80e66df9-3a6f-4712-a539-864ff2d91ed2'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:05.495036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0593d4f44b9840f2bd338c5f4bf0795c', 'request_id': 'req-80e66df9-3a6f-4712-a539-864ff2d91ed2'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:05.505695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] The token cache is being invalidate because project 0593d4f44b9840f2bd338c5f4bf0795c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:24:05.506011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:05.506662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-80e66df9-3a6f-4712-a539-864ff2d91ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:05.508208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1215/2436] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:24:05 2022] DELETE /identity/v3/projects/0593d4f44b9840f2bd338c5f4bf0795c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:05.513491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0672ca-8def-4168-b593-a5ccc4a7bcfd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:05.513942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0672ca-8def-4168-b593-a5ccc4a7bcfd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:05.514094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0672ca-8def-4168-b593-a5ccc4a7bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:05.531566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2e0672ca-8def-4168-b593-a5ccc4a7bcfd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:05.532777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2e0672ca-8def-4168-b593-a5ccc4a7bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:05.591993 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1222/2437] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:05.600745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef746f0-843f-4e57-8a0e-9b19b9736fd3 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:05.601040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef746f0-843f-4e57-8a0e-9b19b9736fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:05.601325 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef746f0-843f-4e57-8a0e-9b19b9736fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:05.620293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-bef746f0-843f-4e57-8a0e-9b19b9736fd3 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:05.621472 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bef746f0-843f-4e57-8a0e-9b19b9736fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:05.629604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1216/2438] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:05.633803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0672ca-8def-4168-b593-a5ccc4a7bcfd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:05.643359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0672ca-8def-4168-b593-a5ccc4a7bcfd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:05.647979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:05.648619 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:05.648910 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:05.649196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:05.649923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:24:05.650268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:05.651896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:05.663609 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1223/2439] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:24:05.668303 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef746f0-843f-4e57-8a0e-9b19b9736fd3 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:05.677469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef746f0-843f-4e57-8a0e-9b19b9736fd3 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:05.682566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287eaf-6ed0-4d44-9be0-98765cc66939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:05.683209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287eaf-6ed0-4d44-9be0-98765cc66939 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:05.683497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287eaf-6ed0-4d44-9be0-98765cc66939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:05.683781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52287eaf-6ed0-4d44-9be0-98765cc66939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:05.684453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52287eaf-6ed0-4d44-9be0-98765cc66939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:05.686422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52287eaf-6ed0-4d44-9be0-98765cc66939 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:05.787180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1217/2440] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:24:05 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:05.791071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:05.801542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b00845-42c0-4e18-81b0-aa3b6b445055 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:05.858499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9699a-3184-46ad-81fc-d56a4237fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:05.859178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9699a-3184-46ad-81fc-d56a4237fe86 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:05.859467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9699a-3184-46ad-81fc-d56a4237fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:05.859750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9699a-3184-46ad-81fc-d56a4237fe86 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:05.860455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9699a-3184-46ad-81fc-d56a4237fe86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:05.862491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9699a-3184-46ad-81fc-d56a4237fe86 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:05.870139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:05.955387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1224/2441] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:24:05 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:05.961400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287eaf-6ed0-4d44-9be0-98765cc66939 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:05.967574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52287eaf-6ed0-4d44-9be0-98765cc66939 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:05.975973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d8664-e8b9-4a9c-a7f2-6d35da3300bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:05.977228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d8664-e8b9-4a9c-a7f2-6d35da3300bf admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:05.977520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d8664-e8b9-4a9c-a7f2-6d35da3300bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:05.977800 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d8664-e8b9-4a9c-a7f2-6d35da3300bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:05.978571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d8664-e8b9-4a9c-a7f2-6d35da3300bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:05.980184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d8664-e8b9-4a9c-a7f2-6d35da3300bf admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:05.990954 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1218/2442] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:05.994794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9699a-3184-46ad-81fc-d56a4237fe86 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:06.004571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9699a-3184-46ad-81fc-d56a4237fe86 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:06.009182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b6646-21c8-43a8-b4dd-db9c9ad57e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:06.009845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b6646-21c8-43a8-b4dd-db9c9ad57e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:06.010162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b6646-21c8-43a8-b4dd-db9c9ad57e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:06.010444 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b6646-21c8-43a8-b4dd-db9c9ad57e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:06.011166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b6646-21c8-43a8-b4dd-db9c9ad57e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:06.012768 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b6646-21c8-43a8-b4dd-db9c9ad57e95 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:06.023006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1225/2443] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:06.027543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d8664-e8b9-4a9c-a7f2-6d35da3300bf admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:06.037713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d8664-e8b9-4a9c-a7f2-6d35da3300bf admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:06.043018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:06.043896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:06.044188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:06.044471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] PATH_INFO: `/v3/projects/14ee2ded197647ffa9b76debd5ae01b7/users/a18fa6da386c4d07b41dea41a661d839/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:06.056341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:06.059315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ee2ded197647ffa9b76debd5ae01b7, user_id=a18fa6da386c4d07b41dea41a661d839, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:06.062041 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:06.153549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1219/2444] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:06 2022] PUT /identity/v3/projects/14ee2ded197647ffa9b76debd5ae01b7/users/a18fa6da386c4d07b41dea41a661d839/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:06.158837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36237b-93d5-4adf-818e-c10137b7f354 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:06.159140 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36237b-93d5-4adf-818e-c10137b7f354 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:06.159423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36237b-93d5-4adf-818e-c10137b7f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:06.177214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9c36237b-93d5-4adf-818e-c10137b7f354 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:06.178479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9c36237b-93d5-4adf-818e-c10137b7f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:06.242244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1226/2445] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:24:06.251990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:06.253778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:06.313347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f9c18-9d60-4f9e-80d4-43aa82570c69 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:06.316987 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985e64-0a0e-4ca9-928c-6f232ed46826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:06.317628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985e64-0a0e-4ca9-928c-6f232ed46826 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:06.317911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985e64-0a0e-4ca9-928c-6f232ed46826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:06.318215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985e64-0a0e-4ca9-928c-6f232ed46826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:06.327537 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be985e64-0a0e-4ca9-928c-6f232ed46826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:06.328959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be985e64-0a0e-4ca9-928c-6f232ed46826 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:06.338743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1220/2446] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:11.433657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570ae-5f50-4e26-96a7-babb27e0194d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:11.434254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570ae-5f50-4e26-96a7-babb27e0194d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:11.434254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570ae-5f50-4e26-96a7-babb27e0194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:11.462241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-194570ae-5f50-4e26-96a7-babb27e0194d None None] MFA Rules not processed for user `a18fa6da386c4d07b41dea41a661d839`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:11.463451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-194570ae-5f50-4e26-96a7-babb27e0194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:11.532977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1227/2447] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:11.537733 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985e64-0a0e-4ca9-928c-6f232ed46826 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:11.548010 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be985e64-0a0e-4ca9-928c-6f232ed46826 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:11.552960 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b412fc0-b42d-42d7-a79b-ab0fc87c1eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:11.553854 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b412fc0-b42d-42d7-a79b-ab0fc87c1eca admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:11.554213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b412fc0-b42d-42d7-a79b-ab0fc87c1eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:11.554551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b412fc0-b42d-42d7-a79b-ab0fc87c1eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:11.555254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b412fc0-b42d-42d7-a79b-ab0fc87c1eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:11.557252 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b412fc0-b42d-42d7-a79b-ab0fc87c1eca admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:11.672496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1221/2448] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:24:11 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:11.676557 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194570ae-5f50-4e26-96a7-babb27e0194d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:11.687757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194570ae-5f50-4e26-96a7-babb27e0194d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:11.747859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e813-e539-42ed-9f64-384fc448bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:11.748565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e813-e539-42ed-9f64-384fc448bd36 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:11.748855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e813-e539-42ed-9f64-384fc448bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:11.749137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e813-e539-42ed-9f64-384fc448bd36 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:11.749903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6e813-e539-42ed-9f64-384fc448bd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:11.752350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6e813-e539-42ed-9f64-384fc448bd36 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:11.857212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:11.863986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1228/2449] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:24:11 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:11.868536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b412fc0-b42d-42d7-a79b-ab0fc87c1eca admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:11.880015 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b412fc0-b42d-42d7-a79b-ab0fc87c1eca admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:11.885697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ed96-288e-4377-9ef4-b1351ae50a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:11.886618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ed96-288e-4377-9ef4-b1351ae50a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:11.886903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ed96-288e-4377-9ef4-b1351ae50a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:11.887183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ed96-288e-4377-9ef4-b1351ae50a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:11.888055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88ed96-288e-4377-9ef4-b1351ae50a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:11.889679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88ed96-288e-4377-9ef4-b1351ae50a84 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:11.901012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1222/2450] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:24:11.905461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e813-e539-42ed-9f64-384fc448bd36 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:11.915904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e813-e539-42ed-9f64-384fc448bd36 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:11.920657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62b198-15ab-453f-98e9-b26f6c109d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:11.921544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b198-15ab-453f-98e9-b26f6c109d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:11.921831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b198-15ab-453f-98e9-b26f6c109d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:11.922194 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b198-15ab-453f-98e9-b26f6c109d34 admin admin] PATH_INFO: `/v3/projects/b0ce9d519c39444fbb011c47d0550739/users/0d40077d968042fa92f07918841facb4/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:11.938228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62b198-15ab-453f-98e9-b26f6c109d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ce9d519c39444fbb011c47d0550739, user_id=0d40077d968042fa92f07918841facb4, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:11.941329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62b198-15ab-453f-98e9-b26f6c109d34 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:12.062589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1229/2451] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:11 2022] PUT /identity/v3/projects/b0ce9d519c39444fbb011c47d0550739/users/0d40077d968042fa92f07918841facb4/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:12.066358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ed96-288e-4377-9ef4-b1351ae50a84 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:12.076803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ed96-288e-4377-9ef4-b1351ae50a84 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:12.147827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d57b-e071-47e6-810e-5eb972be09bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:12.147981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d57b-e071-47e6-810e-5eb972be09bd admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:12.148294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d57b-e071-47e6-810e-5eb972be09bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:12.148568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d57b-e071-47e6-810e-5eb972be09bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:12.149332 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d57b-e071-47e6-810e-5eb972be09bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:12.151271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d57b-e071-47e6-810e-5eb972be09bd admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:12.163489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1223/2452] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:12.167916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62b198-15ab-453f-98e9-b26f6c109d34 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:12.178836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62b198-15ab-453f-98e9-b26f6c109d34 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:12.183607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:12.184488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:12.184791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:12.185052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] PATH_INFO: `/v3/projects/b0ce9d519c39444fbb011c47d0550739/users/0d40077d968042fa92f07918841facb4/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:12.187027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ce9d519c39444fbb011c47d0550739, user_id=0d40077d968042fa92f07918841facb4, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:12.189683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:12.200265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1230/2453] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:12 2022] PUT /identity/v3/projects/b0ce9d519c39444fbb011c47d0550739/users/0d40077d968042fa92f07918841facb4/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:18.823512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b356fa-c38e-44e1-8943-b7e65bf6ef31 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:18.824082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b356fa-c38e-44e1-8943-b7e65bf6ef31 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:18.824628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b356fa-c38e-44e1-8943-b7e65bf6ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:18.860458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-86b356fa-c38e-44e1-8943-b7e65bf6ef31 None None] MFA Rules not processed for user `0d40077d968042fa92f07918841facb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:18.861710 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-86b356fa-c38e-44e1-8943-b7e65bf6ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:18.914972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:18.941834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1224/2454] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:18.958422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:18.960743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:19.026240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a6a67-5127-4345-9786-07618c5e1abc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:19.029898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca08d82f02a24e0088aceff2b6ba307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:19.030921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:19.031210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:19.031493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:19.090124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:19.091586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:19.100508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1231/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:19.371599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a62af8-78ef-4297-bcb5-4f542f4709dc None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:19.371932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a62af8-78ef-4297-bcb5-4f542f4709dc None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:19.372329 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a62af8-78ef-4297-bcb5-4f542f4709dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:19.391323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-83a62af8-78ef-4297-bcb5-4f542f4709dc None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:19.392587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-83a62af8-78ef-4297-bcb5-4f542f4709dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:19.449760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1225/2456] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:19.475562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:19.478147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:19.571606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b4a76-973c-4f5a-9d9b-0fcf465e596e service glance] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:19.578629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:19.579403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:19.579809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:19.580189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:19.589296 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:19.591145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:19.599998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1232/2457] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:24:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:24:22.509005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a62af8-78ef-4297-bcb5-4f542f4709dc None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:22.584962 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a62af8-78ef-4297-bcb5-4f542f4709dc None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:22.594826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:22.595806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:22.596283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:22.596958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:22.599032 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:22.686307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:22.688124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:22.701199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1226/2458] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:26.928692 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:26.932491 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:26.959898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf12980-5a24-4338-9896-06e1d239040b service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:26.965876 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:26.966820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:26.967111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:26.967391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] PATH_INFO: `/v3/users/e32767611f7d417184f55c8e7fa645b4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:26.968598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32767611f7d417184f55c8e7fa645b4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:26.970652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:26.972389 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:27.183331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32767611f7d417184f55c8e7fa645b4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.193898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32767611f7d417184f55c8e7fa645b4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.291807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32767611f7d417184f55c8e7fa645b4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.292434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32767611f7d417184f55c8e7fa645b4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.293060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a19fb43a-1581-48cb-9a13-d937eb3c4b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32767611f7d417184f55c8e7fa645b4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.322618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1233/2459] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:24:26 2022] DELETE /identity/v3/users/e32767611f7d417184f55c8e7fa645b4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:27.605844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:27.616568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2ba3-7855-4c00-805a-3127365f0496 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:27.663228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:27.692400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:27.693441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:27.693744 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:27.694323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] PATH_INFO: `/v3/projects/4538b18a36d843058fd43df98ded9c41` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:27.696802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4538b18a36d843058fd43df98ded9c41)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:27.699255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:27.804615 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4538b18a36d843058fd43df98ded9c41', 'request_id': 'req-a3a848f9-a2ec-484e-9a91-68d3a1650f91'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.811424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4538b18a36d843058fd43df98ded9c41', 'request_id': 'req-a3a848f9-a2ec-484e-9a91-68d3a1650f91'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.910159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4538b18a36d843058fd43df98ded9c41', 'request_id': 'req-a3a848f9-a2ec-484e-9a91-68d3a1650f91'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.926043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] The token cache is being invalidate because project 4538b18a36d843058fd43df98ded9c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:24:27.926488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.927297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a3a848f9-a2ec-484e-9a91-68d3a1650f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:27.929322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1227/2460] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:24:27 2022] DELETE /identity/v3/projects/4538b18a36d843058fd43df98ded9c41 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:27.934242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87387c0-b8cb-48b7-bd82-f6a50968d374 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:27.935249 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87387c0-b8cb-48b7-bd82-f6a50968d374 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:27.935763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87387c0-b8cb-48b7-bd82-f6a50968d374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:27.955918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a87387c0-b8cb-48b7-bd82-f6a50968d374 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:27.957615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a87387c0-b8cb-48b7-bd82-f6a50968d374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:28.032931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1234/2461] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:28.041482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ca2f9-7a40-4227-996a-3634a56359d9 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.041786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ca2f9-7a40-4227-996a-3634a56359d9 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.042130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ca2f9-7a40-4227-996a-3634a56359d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.062235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5c1ca2f9-7a40-4227-996a-3634a56359d9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:28.063596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5c1ca2f9-7a40-4227-996a-3634a56359d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:28.073646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1228/2462] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:28.078383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87387c0-b8cb-48b7-bd82-f6a50968d374 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:28.091805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87387c0-b8cb-48b7-bd82-f6a50968d374 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:28.096488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:28.097155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.097441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.097719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.099030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:24:28.099030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:28.100701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:28.120625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1235/2463] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:24:28.124967 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ca2f9-7a40-4227-996a-3634a56359d9 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:28.139571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ca2f9-7a40-4227-996a-3634a56359d9 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:28.144418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf9d2-a0bc-4e93-a4c8-40446cb59a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:28.150044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf9d2-a0bc-4e93-a4c8-40446cb59a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.150044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf9d2-a0bc-4e93-a4c8-40446cb59a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.150044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf9d2-a0bc-4e93-a4c8-40446cb59a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.150044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf9d2-a0bc-4e93-a4c8-40446cb59a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:28.152111 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf9d2-a0bc-4e93-a4c8-40446cb59a46 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:28.271654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1229/2464] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:24:28 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:28.278505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:28.290037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984fd61-ac17-4053-8993-c82d7bfd3166 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:28.357669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfafcd-2c96-4737-8e01-be9cb97c52da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:28.358530 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfafcd-2c96-4737-8e01-be9cb97c52da admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.358885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfafcd-2c96-4737-8e01-be9cb97c52da admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.359233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfafcd-2c96-4737-8e01-be9cb97c52da admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.359995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfafcd-2c96-4737-8e01-be9cb97c52da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:28.362541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfafcd-2c96-4737-8e01-be9cb97c52da admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:28.372862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:28.471842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1236/2465] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:24:28 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:28.476665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf9d2-a0bc-4e93-a4c8-40446cb59a46 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:28.492246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf9d2-a0bc-4e93-a4c8-40446cb59a46 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:28.496860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d129550-9e33-4c30-9006-d0314aa81a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:28.497533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129550-9e33-4c30-9006-d0314aa81a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.497810 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129550-9e33-4c30-9006-d0314aa81a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.503084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129550-9e33-4c30-9006-d0314aa81a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.503084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d129550-9e33-4c30-9006-d0314aa81a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:28.503084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d129550-9e33-4c30-9006-d0314aa81a25 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:28.513118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1230/2466] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:28.518002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfafcd-2c96-4737-8e01-be9cb97c52da admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:28.529555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfafcd-2c96-4737-8e01-be9cb97c52da admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:28.536195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fb0b8-640e-4099-93ad-f06914e60dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:28.537084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fb0b8-640e-4099-93ad-f06914e60dce admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.537212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fb0b8-640e-4099-93ad-f06914e60dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.537432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fb0b8-640e-4099-93ad-f06914e60dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.538221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fb0b8-640e-4099-93ad-f06914e60dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:28.540792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fb0b8-640e-4099-93ad-f06914e60dce admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:28.558214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1237/2467] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:28.559697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d129550-9e33-4c30-9006-d0314aa81a25 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:28.572381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d129550-9e33-4c30-9006-d0314aa81a25 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:28.577531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b8320-7f2f-42b9-825b-2037605f5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:28.578644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8320-7f2f-42b9-825b-2037605f5d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.578931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8320-7f2f-42b9-825b-2037605f5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.579212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8320-7f2f-42b9-825b-2037605f5d8e admin admin] PATH_INFO: `/v3/projects/8274056effc44aa5a080e3a2bece92bb/users/372008c3413f4c0ab6371d5b599a0b35/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.597458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b8320-7f2f-42b9-825b-2037605f5d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8274056effc44aa5a080e3a2bece92bb, user_id=372008c3413f4c0ab6371d5b599a0b35, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:28.600246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b8320-7f2f-42b9-825b-2037605f5d8e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:28.680939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1231/2468] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:28 2022] PUT /identity/v3/projects/8274056effc44aa5a080e3a2bece92bb/users/372008c3413f4c0ab6371d5b599a0b35/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:28.682861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08058-29a9-48c6-b05e-445606cbdc7a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.683165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08058-29a9-48c6-b05e-445606cbdc7a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.683454 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08058-29a9-48c6-b05e-445606cbdc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.714424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f4f08058-29a9-48c6-b05e-445606cbdc7a None None] MFA Rules not processed for user `372008c3413f4c0ab6371d5b599a0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:28.715872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f4f08058-29a9-48c6-b05e-445606cbdc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:28.805559 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1238/2469] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:28.811455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b8320-7f2f-42b9-825b-2037605f5d8e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:28.884200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b8320-7f2f-42b9-825b-2037605f5d8e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:28.889086 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154b0f-cbe8-41b8-88e5-bac92f516238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:28.889827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154b0f-cbe8-41b8-88e5-bac92f516238 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:28.890221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154b0f-cbe8-41b8-88e5-bac92f516238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:28.890506 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154b0f-cbe8-41b8-88e5-bac92f516238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:28.891210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32154b0f-cbe8-41b8-88e5-bac92f516238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:28.893154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32154b0f-cbe8-41b8-88e5-bac92f516238 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:28.906232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:28.980741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1232/2470] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:24:28 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:24:28.986264 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f08058-29a9-48c6-b05e-445606cbdc7a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:28.998702 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f08058-29a9-48c6-b05e-445606cbdc7a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:29.064506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd712a2-e035-4be9-a82a-b69a20fb70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:29.065103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd712a2-e035-4be9-a82a-b69a20fb70b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:29.065393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd712a2-e035-4be9-a82a-b69a20fb70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:29.065696 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd712a2-e035-4be9-a82a-b69a20fb70b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:29.066453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd712a2-e035-4be9-a82a-b69a20fb70b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:29.068433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd712a2-e035-4be9-a82a-b69a20fb70b0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:29.184776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1239/2471] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:24:28 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:24:29.193865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154b0f-cbe8-41b8-88e5-bac92f516238 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:29.197338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154b0f-cbe8-41b8-88e5-bac92f516238 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:29.202097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048dbf-3de2-46fe-ba61-658d25bb15ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:29.202795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048dbf-3de2-46fe-ba61-658d25bb15ff admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:29.203085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048dbf-3de2-46fe-ba61-658d25bb15ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:29.203362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048dbf-3de2-46fe-ba61-658d25bb15ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:29.204096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96048dbf-3de2-46fe-ba61-658d25bb15ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:29.205886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96048dbf-3de2-46fe-ba61-658d25bb15ff admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:29.218945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1233/2472] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:29.223090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd712a2-e035-4be9-a82a-b69a20fb70b0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:29.235772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd712a2-e035-4be9-a82a-b69a20fb70b0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:29.240856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0a42-694e-4193-a6a6-382a6147112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:29.242416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0a42-694e-4193-a6a6-382a6147112e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:29.242704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0a42-694e-4193-a6a6-382a6147112e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:29.242984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0a42-694e-4193-a6a6-382a6147112e admin admin] PATH_INFO: `/v3/projects/80cc2e99c23b4816a841f56a312cff3c/users/a3cb889ab87b476390345a80f819cdf9/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:29.260142 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b0a42-694e-4193-a6a6-382a6147112e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cc2e99c23b4816a841f56a312cff3c, user_id=a3cb889ab87b476390345a80f819cdf9, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:29.291353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b0a42-694e-4193-a6a6-382a6147112e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:29.701615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1240/2473] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:29 2022] PUT /identity/v3/projects/80cc2e99c23b4816a841f56a312cff3c/users/a3cb889ab87b476390345a80f819cdf9/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:24:29.705642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048dbf-3de2-46fe-ba61-658d25bb15ff admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:29.716119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048dbf-3de2-46fe-ba61-658d25bb15ff admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:29.771892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8451784-7377-42ac-92bc-170607729c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:29.773191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451784-7377-42ac-92bc-170607729c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:29.773539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451784-7377-42ac-92bc-170607729c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:29.773824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451784-7377-42ac-92bc-170607729c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:29.774595 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8451784-7377-42ac-92bc-170607729c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:29.776224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8451784-7377-42ac-92bc-170607729c8b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:29.790076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1234/2474] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:29.791263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0a42-694e-4193-a6a6-382a6147112e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:29.801652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0a42-694e-4193-a6a6-382a6147112e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:29.806767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:29.807650 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:29.807933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:29.808237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] PATH_INFO: `/v3/projects/80cc2e99c23b4816a841f56a312cff3c/users/a3cb889ab87b476390345a80f819cdf9/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:29.810222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cc2e99c23b4816a841f56a312cff3c, user_id=a3cb889ab87b476390345a80f819cdf9, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:29.812860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:29.823721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1241/2475] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:29 2022] PUT /identity/v3/projects/80cc2e99c23b4816a841f56a312cff3c/users/a3cb889ab87b476390345a80f819cdf9/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:29.834055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e460a3-abcb-491c-bc08-24bb9234cf18 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:29.834371 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e460a3-abcb-491c-bc08-24bb9234cf18 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:29.834762 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e460a3-abcb-491c-bc08-24bb9234cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:29.862748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-c6e460a3-abcb-491c-bc08-24bb9234cf18 None None] MFA Rules not processed for user `a3cb889ab87b476390345a80f819cdf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:29.864263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c6e460a3-abcb-491c-bc08-24bb9234cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:29.955831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1235/2476] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:29.964363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:29.966180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:30.002873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:30.032293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7520b6-79da-4359-813f-4ea2374a6f91 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:30.037091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa54ea-3933-4476-af4d-ed67aa6dbeb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:30.037988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa54ea-3933-4476-af4d-ed67aa6dbeb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:30.038998 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa54ea-3933-4476-af4d-ed67aa6dbeb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:30.039439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa54ea-3933-4476-af4d-ed67aa6dbeb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:30.049311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa54ea-3933-4476-af4d-ed67aa6dbeb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:30.051107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa54ea-3933-4476-af4d-ed67aa6dbeb0 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:30.062481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1242/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:30.330760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e460a3-abcb-491c-bc08-24bb9234cf18 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:30.340524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e460a3-abcb-491c-bc08-24bb9234cf18 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:30.344274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb94acd-22a7-4358-aa58-f8792b5987fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:30.344927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb94acd-22a7-4358-aa58-f8792b5987fa service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:30.345218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb94acd-22a7-4358-aa58-f8792b5987fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:30.345509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb94acd-22a7-4358-aa58-f8792b5987fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:30.404946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb94acd-22a7-4358-aa58-f8792b5987fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:30.406842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb94acd-22a7-4358-aa58-f8792b5987fa service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:30.410572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:30.417661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1236/2478] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:30.771313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad4a6-0a5b-43f7-89c0-c67f16930fe6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:30.771604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad4a6-0a5b-43f7-89c0-c67f16930fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:30.771885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdad4a6-0a5b-43f7-89c0-c67f16930fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:30.789743 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7fdad4a6-0a5b-43f7-89c0-c67f16930fe6 None None] MFA Rules not processed for user `a18fa6da386c4d07b41dea41a661d839`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:30.790951 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7fdad4a6-0a5b-43f7-89c0-c67f16930fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:30.845020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1243/2479] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:34.483921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c88a9-ee4e-479c-a30a-9af862a7f14f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:34.484811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c88a9-ee4e-479c-a30a-9af862a7f14f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:34.484811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c88a9-ee4e-479c-a30a-9af862a7f14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:34.501894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ff7c88a9-ee4e-479c-a30a-9af862a7f14f None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:34.503193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ff7c88a9-ee4e-479c-a30a-9af862a7f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:34.561391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1237/2480] 10.222.0.48 () {58 vars in 1009 bytes} [Mon May 30 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:34.574524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdad4a6-0a5b-43f7-89c0-c67f16930fe6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:34.575994 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7fdad4a6-0a5b-43f7-89c0-c67f16930fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:34.646955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdad4a6-0a5b-43f7-89c0-c67f16930fe6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:34.652863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48bad5-747e-44fb-a84d-7da666b072b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:34.654751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48bad5-747e-44fb-a84d-7da666b072b3 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:34.654751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48bad5-747e-44fb-a84d-7da666b072b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:34.654751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48bad5-747e-44fb-a84d-7da666b072b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:34.663895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48bad5-747e-44fb-a84d-7da666b072b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:34.665521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48bad5-747e-44fb-a84d-7da666b072b3 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:34.673995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1244/2481] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:24:40.883351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c88a9-ee4e-479c-a30a-9af862a7f14f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:40.951661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c88a9-ee4e-479c-a30a-9af862a7f14f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:40.956170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:40.957201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:40.957512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:40.957767 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] PATH_INFO: `/v3/users/372008c3413f4c0ab6371d5b599a0b35` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:40.959020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=372008c3413f4c0ab6371d5b599a0b35)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:40.961271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:41.126298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372008c3413f4c0ab6371d5b599a0b35'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:41.133282 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372008c3413f4c0ab6371d5b599a0b35'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:41.133979 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372008c3413f4c0ab6371d5b599a0b35'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:41.134635 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372008c3413f4c0ab6371d5b599a0b35'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:41.209275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372008c3413f4c0ab6371d5b599a0b35'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:41.232318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1238/2482] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:24:40 2022] DELETE /identity/v3/users/372008c3413f4c0ab6371d5b599a0b35 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:24:41.236787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18571-9931-4477-9ee0-daa50a9e9dd4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:41.237274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18571-9931-4477-9ee0-daa50a9e9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:41.237379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d18571-9931-4477-9ee0-daa50a9e9dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:41.256090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-71d18571-9931-4477-9ee0-daa50a9e9dd4 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:41.267847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-71d18571-9931-4477-9ee0-daa50a9e9dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:41.327662 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1245/2483] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:41.338089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:41.339499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:41.366654 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:41.400505 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb4e5a-3f16-4afa-96f0-721f318df974 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:41.404600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b59b0-76a2-4153-959e-b8d04142b426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:41.405796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b59b0-76a2-4153-959e-b8d04142b426 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:41.406204 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b59b0-76a2-4153-959e-b8d04142b426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:41.406575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b59b0-76a2-4153-959e-b8d04142b426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:41.417432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b59b0-76a2-4153-959e-b8d04142b426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:41.419017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b59b0-76a2-4153-959e-b8d04142b426 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:41.429460 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1239/2484] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:41.841035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d18571-9931-4477-9ee0-daa50a9e9dd4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:41.842381 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-71d18571-9931-4477-9ee0-daa50a9e9dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:41.855121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:41.869801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d18571-9931-4477-9ee0-daa50a9e9dd4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:41.874806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:41.875684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:41.875970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:41.876246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] PATH_INFO: `/v3/projects/8274056effc44aa5a080e3a2bece92bb` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:41.878831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8274056effc44aa5a080e3a2bece92bb)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:41.882279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:42.010147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8274056effc44aa5a080e3a2bece92bb', 'request_id': 'req-720faed5-3130-443d-971a-c6aa3916479e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.060138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8274056effc44aa5a080e3a2bece92bb', 'request_id': 'req-720faed5-3130-443d-971a-c6aa3916479e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.067094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8274056effc44aa5a080e3a2bece92bb', 'request_id': 'req-720faed5-3130-443d-971a-c6aa3916479e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.078250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] The token cache is being invalidate because project 8274056effc44aa5a080e3a2bece92bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:24:42.078580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.079222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.080801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1246/2485] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:24:41 2022] DELETE /identity/v3/projects/8274056effc44aa5a080e3a2bece92bb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:42.085531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b59b0-76a2-4153-959e-b8d04142b426 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:42.095601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b59b0-76a2-4153-959e-b8d04142b426 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:42.155852 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:42.156727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:42.157009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:42.157284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] PATH_INFO: `/v3/users/a3cb889ab87b476390345a80f819cdf9` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:42.158513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cb889ab87b476390345a80f819cdf9)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:42.160488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:42.369031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cb889ab87b476390345a80f819cdf9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.378882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cb889ab87b476390345a80f819cdf9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.379607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cb889ab87b476390345a80f819cdf9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.380209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cb889ab87b476390345a80f819cdf9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.469570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e472d79f-51a5-4260-86c7-357baeec448f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cb889ab87b476390345a80f819cdf9'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:42.488791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1240/2486] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:24:42 2022] DELETE /identity/v3/users/a3cb889ab87b476390345a80f819cdf9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:24:42.883735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:42.883735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:42.895122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720faed5-3130-443d-971a-c6aa3916479e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:42.958082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:42.959121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:42.959496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:42.959924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] PATH_INFO: `/v3/projects/80cc2e99c23b4816a841f56a312cff3c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:42.961257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80cc2e99c23b4816a841f56a312cff3c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:42.963322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:43.083891 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cc2e99c23b4816a841f56a312cff3c', 'request_id': 'req-072b17db-4b2f-43b2-941d-2299460e4f29'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:43.180843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cc2e99c23b4816a841f56a312cff3c', 'request_id': 'req-072b17db-4b2f-43b2-941d-2299460e4f29'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:43.188944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cc2e99c23b4816a841f56a312cff3c', 'request_id': 'req-072b17db-4b2f-43b2-941d-2299460e4f29'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:43.200524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] The token cache is being invalidate because project 80cc2e99c23b4816a841f56a312cff3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:24:43.200819 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:43.201516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-072b17db-4b2f-43b2-941d-2299460e4f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:43.203374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1247/2487] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:24:42 2022] DELETE /identity/v3/projects/80cc2e99c23b4816a841f56a312cff3c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:43.208357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f92c-253a-4ef4-8d0e-cdfd46c90413 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.209106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f92c-253a-4ef4-8d0e-cdfd46c90413 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.209106 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5f92c-253a-4ef4-8d0e-cdfd46c90413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.228370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-50a5f92c-253a-4ef4-8d0e-cdfd46c90413 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:43.229597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-50a5f92c-253a-4ef4-8d0e-cdfd46c90413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:43.274941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:43.298299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1241/2488] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:43.307730 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878d66f-ac4d-499d-9794-53495af10c05 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.308027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878d66f-ac4d-499d-9794-53495af10c05 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.308316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878d66f-ac4d-499d-9794-53495af10c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.348333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e878d66f-ac4d-499d-9794-53495af10c05 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:43.349598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e878d66f-ac4d-499d-9794-53495af10c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:43.369461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1248/2489] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:43.374136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5f92c-253a-4ef4-8d0e-cdfd46c90413 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:43.384142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5f92c-253a-4ef4-8d0e-cdfd46c90413 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:43.389362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:43.390980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.391346 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.391646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.392375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:24:43.392681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:43.394347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:43.407523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1242/2490] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:24:43.412084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878d66f-ac4d-499d-9794-53495af10c05 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:43.422544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878d66f-ac4d-499d-9794-53495af10c05 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:43.427855 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f7b4-2b8d-4bef-83b1-79381115bbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:43.428566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f7b4-2b8d-4bef-83b1-79381115bbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.428852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f7b4-2b8d-4bef-83b1-79381115bbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.429131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f7b4-2b8d-4bef-83b1-79381115bbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.429827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5f7b4-2b8d-4bef-83b1-79381115bbe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:43.431877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5f7b4-2b8d-4bef-83b1-79381115bbe9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:43.440564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:43.537077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1249/2491] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:24:43 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:24:43.541645 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:43.552057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858fa02-4e4b-4179-ae2d-825cbce136ee admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:43.614326 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bb15f-acc4-4db8-8e3b-3317578c026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:43.615004 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bb15f-acc4-4db8-8e3b-3317578c026a admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.615294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bb15f-acc4-4db8-8e3b-3317578c026a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.615576 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bb15f-acc4-4db8-8e3b-3317578c026a admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.616315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bb15f-acc4-4db8-8e3b-3317578c026a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:43.618279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bb15f-acc4-4db8-8e3b-3317578c026a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:43.724118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1243/2492] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:24:43 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:43.728685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f7b4-2b8d-4bef-83b1-79381115bbe9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:43.738929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f7b4-2b8d-4bef-83b1-79381115bbe9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:43.744175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee0f0-7752-4314-9093-888dafbe63be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:43.744838 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee0f0-7752-4314-9093-888dafbe63be admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.745129 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee0f0-7752-4314-9093-888dafbe63be admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.745408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee0f0-7752-4314-9093-888dafbe63be admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.746254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ee0f0-7752-4314-9093-888dafbe63be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:43.750884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ee0f0-7752-4314-9093-888dafbe63be admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:43.758253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1250/2493] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:43.762244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bb15f-acc4-4db8-8e3b-3317578c026a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:43.772683 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bb15f-acc4-4db8-8e3b-3317578c026a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:43.778152 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f800aa-675a-43e9-910d-97655137d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:43.778972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f800aa-675a-43e9-910d-97655137d227 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.779418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f800aa-675a-43e9-910d-97655137d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.779706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f800aa-675a-43e9-910d-97655137d227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.780703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f800aa-675a-43e9-910d-97655137d227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:43.782380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f800aa-675a-43e9-910d-97655137d227 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:43.798027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1244/2494] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:43.798837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee0f0-7752-4314-9093-888dafbe63be admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:43.817991 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee0f0-7752-4314-9093-888dafbe63be admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:43.822931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ee072-f3d4-4983-914f-477c32eb95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:43.823825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ee072-f3d4-4983-914f-477c32eb95de admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.824111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ee072-f3d4-4983-914f-477c32eb95de admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.824391 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ee072-f3d4-4983-914f-477c32eb95de admin admin] PATH_INFO: `/v3/projects/405a304b24134f3cb401192030197a4a/users/6d12f3eb071b4c5bb9f49b785714480f/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.839721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ee072-f3d4-4983-914f-477c32eb95de admin admin] RBAC: Authorizing `identity:create_grant(project_id=405a304b24134f3cb401192030197a4a, user_id=6d12f3eb071b4c5bb9f49b785714480f, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:43.842409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ee072-f3d4-4983-914f-477c32eb95de admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:43.913323 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1251/2495] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:43 2022] PUT /identity/v3/projects/405a304b24134f3cb401192030197a4a/users/6d12f3eb071b4c5bb9f49b785714480f/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:24:43.923618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebe2a-be70-4065-9e2b-550025b2e933 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:43.923912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebe2a-be70-4065-9e2b-550025b2e933 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:43.924195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebe2a-be70-4065-9e2b-550025b2e933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:43.960942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-6e4ebe2a-be70-4065-9e2b-550025b2e933 None None] MFA Rules not processed for user `6d12f3eb071b4c5bb9f49b785714480f`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:43.962226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6e4ebe2a-be70-4065-9e2b-550025b2e933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:44.031892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1245/2496] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:44.036479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ee072-f3d4-4983-914f-477c32eb95de admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:44.104215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ee072-f3d4-4983-914f-477c32eb95de admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:44.109214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0158a-4b17-4621-9375-3dfca01c8ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:44.109881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0158a-4b17-4621-9375-3dfca01c8ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:44.110202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0158a-4b17-4621-9375-3dfca01c8ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:44.110482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0158a-4b17-4621-9375-3dfca01c8ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:44.111192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0158a-4b17-4621-9375-3dfca01c8ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:44.113206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0158a-4b17-4621-9375-3dfca01c8ba2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:44.194911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1252/2497] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:24:44 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:44.198906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ebe2a-be70-4065-9e2b-550025b2e933 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:44.214471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ebe2a-be70-4065-9e2b-550025b2e933 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:44.262458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:44.284377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eba832-bc97-467a-a3d4-7bc58dfe7316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:44.284377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eba832-bc97-467a-a3d4-7bc58dfe7316 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:44.284795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eba832-bc97-467a-a3d4-7bc58dfe7316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:44.284795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eba832-bc97-467a-a3d4-7bc58dfe7316 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:44.285369 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eba832-bc97-467a-a3d4-7bc58dfe7316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:44.287543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eba832-bc97-467a-a3d4-7bc58dfe7316 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:44.383134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1246/2498] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:24:44 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:24:44.387246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0158a-4b17-4621-9375-3dfca01c8ba2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:44.398078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0158a-4b17-4621-9375-3dfca01c8ba2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:44.402861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cd8a1-4d5d-4e2e-a358-d15675a69f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:44.403536 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd8a1-4d5d-4e2e-a358-d15675a69f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:44.403830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd8a1-4d5d-4e2e-a358-d15675a69f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:44.404104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd8a1-4d5d-4e2e-a358-d15675a69f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:44.404835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cd8a1-4d5d-4e2e-a358-d15675a69f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:44.407099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cd8a1-4d5d-4e2e-a358-d15675a69f69 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:44.420944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1253/2499] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:44.425373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eba832-bc97-467a-a3d4-7bc58dfe7316 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:44.436795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eba832-bc97-467a-a3d4-7bc58dfe7316 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:44.441622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afd73c-87ca-484f-91df-13ca892a054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:44.442553 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd73c-87ca-484f-91df-13ca892a054f admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:44.442844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd73c-87ca-484f-91df-13ca892a054f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:44.443128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd73c-87ca-484f-91df-13ca892a054f admin admin] PATH_INFO: `/v3/projects/b5da2ae4b935419bb515f4e597cf7cdb/users/845dad76630747349f500b68cbf2a3dc/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:44.458847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afd73c-87ca-484f-91df-13ca892a054f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5da2ae4b935419bb515f4e597cf7cdb, user_id=845dad76630747349f500b68cbf2a3dc, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:44.461739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afd73c-87ca-484f-91df-13ca892a054f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:44.912521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1247/2500] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:44 2022] PUT /identity/v3/projects/b5da2ae4b935419bb515f4e597cf7cdb/users/845dad76630747349f500b68cbf2a3dc/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:24:44.917105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cd8a1-4d5d-4e2e-a358-d15675a69f69 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:44.928136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cd8a1-4d5d-4e2e-a358-d15675a69f69 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:44.987405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385e662-0538-4dce-996b-635b8da26dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:44.988076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e662-0538-4dce-996b-635b8da26dee admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:44.988362 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e662-0538-4dce-996b-635b8da26dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:44.988642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385e662-0538-4dce-996b-635b8da26dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:44.989365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385e662-0538-4dce-996b-635b8da26dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:44.991049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385e662-0538-4dce-996b-635b8da26dee admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:45.000800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1254/2501] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:45.005283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afd73c-87ca-484f-91df-13ca892a054f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:45.015458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afd73c-87ca-484f-91df-13ca892a054f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:45.020056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:45.020921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:45.021202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:45.021482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] PATH_INFO: `/v3/projects/b5da2ae4b935419bb515f4e597cf7cdb/users/845dad76630747349f500b68cbf2a3dc/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:45.023925 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5da2ae4b935419bb515f4e597cf7cdb, user_id=845dad76630747349f500b68cbf2a3dc, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:45.026603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:45.037447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1248/2502] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:45 2022] PUT /identity/v3/projects/b5da2ae4b935419bb515f4e597cf7cdb/users/845dad76630747349f500b68cbf2a3dc/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:45.058564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07ede-f59b-486c-9d6a-684872cb15e6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:45.058854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07ede-f59b-486c-9d6a-684872cb15e6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:45.059131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07ede-f59b-486c-9d6a-684872cb15e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:45.085644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9ec07ede-f59b-486c-9d6a-684872cb15e6 None None] MFA Rules not processed for user `845dad76630747349f500b68cbf2a3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:45.088611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9ec07ede-f59b-486c-9d6a-684872cb15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:45.098352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:45.156405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1255/2503] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:45.168110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:45.169862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:45.226827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba715f-cb90-4531-9065-fa3cc190c816 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:45.230533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121a542-5f9e-4221-ae6f-5f0b5b98fdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:45.231179 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a542-5f9e-4221-ae6f-5f0b5b98fdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:45.234896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a542-5f9e-4221-ae6f-5f0b5b98fdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:45.234896 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121a542-5f9e-4221-ae6f-5f0b5b98fdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:45.240678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121a542-5f9e-4221-ae6f-5f0b5b98fdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:45.242153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121a542-5f9e-4221-ae6f-5f0b5b98fdd2 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:45.251451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1249/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:48.191678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec07ede-f59b-486c-9d6a-684872cb15e6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:48.260058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec07ede-f59b-486c-9d6a-684872cb15e6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:48.265672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:48.266612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:48.266902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:48.267186 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] PATH_INFO: `/v3/users/6d12f3eb071b4c5bb9f49b785714480f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:48.268414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d12f3eb071b4c5bb9f49b785714480f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:48.270493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:48.491596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d12f3eb071b4c5bb9f49b785714480f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:48.499212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d12f3eb071b4c5bb9f49b785714480f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:48.591282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d12f3eb071b4c5bb9f49b785714480f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:48.591903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d12f3eb071b4c5bb9f49b785714480f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:48.592555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d12f3eb071b4c5bb9f49b785714480f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:48.626979 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1256/2505] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:24:48 2022] DELETE /identity/v3/users/6d12f3eb071b4c5bb9f49b785714480f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:48.628549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2d6ef-4161-48b0-9821-79b3fe890e48 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:48.629007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2d6ef-4161-48b0-9821-79b3fe890e48 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:48.629143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2d6ef-4161-48b0-9821-79b3fe890e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:48.652053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-f8c2d6ef-4161-48b0-9821-79b3fe890e48 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:48.653641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f8c2d6ef-4161-48b0-9821-79b3fe890e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:48.727313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1250/2506] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:48.739164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:48.740806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:48.791933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:48.824508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4358e6-2a3c-406d-80ed-70f1d7cce56d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:48.828241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14116b1-d3f5-4ada-a998-db02b4f34360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:48.828970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14116b1-d3f5-4ada-a998-db02b4f34360 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:48.829260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14116b1-d3f5-4ada-a998-db02b4f34360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:48.829537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14116b1-d3f5-4ada-a998-db02b4f34360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:48.839977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14116b1-d3f5-4ada-a998-db02b4f34360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:48.841490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14116b1-d3f5-4ada-a998-db02b4f34360 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:48.851874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1257/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:49.587320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2d6ef-4161-48b0-9821-79b3fe890e48 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:49.588774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-f8c2d6ef-4161-48b0-9821-79b3fe890e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:49.606930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2d6ef-4161-48b0-9821-79b3fe890e48 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:49.606930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:49.606930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:49.607242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:49.607480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] PATH_INFO: `/v3/projects/405a304b24134f3cb401192030197a4a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:49.608681 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405a304b24134f3cb401192030197a4a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:49.610903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:49.717429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:49.730185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405a304b24134f3cb401192030197a4a', 'request_id': 'req-a7dace6a-be2d-4901-87f9-a2460a7a94e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:49.736424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405a304b24134f3cb401192030197a4a', 'request_id': 'req-a7dace6a-be2d-4901-87f9-a2460a7a94e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:49.846627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405a304b24134f3cb401192030197a4a', 'request_id': 'req-a7dace6a-be2d-4901-87f9-a2460a7a94e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:49.857714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] The token cache is being invalidate because project 405a304b24134f3cb401192030197a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:24:49.858031 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:49.858697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:49.860238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1251/2508] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:24:49 2022] DELETE /identity/v3/projects/405a304b24134f3cb401192030197a4a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:49.864794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14116b1-d3f5-4ada-a998-db02b4f34360 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:49.874740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14116b1-d3f5-4ada-a998-db02b4f34360 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:49.935036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:49.936024 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:49.936318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:49.936713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] PATH_INFO: `/v3/users/845dad76630747349f500b68cbf2a3dc` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:49.937977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=845dad76630747349f500b68cbf2a3dc)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:49.940405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:50.954314 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845dad76630747349f500b68cbf2a3dc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:50.961093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845dad76630747349f500b68cbf2a3dc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.098217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845dad76630747349f500b68cbf2a3dc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.098825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845dad76630747349f500b68cbf2a3dc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.099422 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b585d171-495b-4400-a366-4516172d1256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845dad76630747349f500b68cbf2a3dc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.117831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1258/2509] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:24:49 2022] DELETE /identity/v3/users/845dad76630747349f500b68cbf2a3dc => generated 0 bytes in 1254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:51.539334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:51.540806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:51.556364 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dace6a-be2d-4901-87f9-a2460a7a94e7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:51.617893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:51.618786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:51.619102 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:51.619377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] PATH_INFO: `/v3/projects/b5da2ae4b935419bb515f4e597cf7cdb` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:51.620622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5da2ae4b935419bb515f4e597cf7cdb)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:51.622551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:51.740647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5da2ae4b935419bb515f4e597cf7cdb', 'request_id': 'req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.746966 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5da2ae4b935419bb515f4e597cf7cdb', 'request_id': 'req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.819630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5da2ae4b935419bb515f4e597cf7cdb', 'request_id': 'req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.831421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] The token cache is being invalidate because project b5da2ae4b935419bb515f4e597cf7cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:24:51.831714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.832345 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-6a688178-9b3a-4892-9be8-9b8c4d4ecbf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:24:51.833971 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1252/2510] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:24:51 2022] DELETE /identity/v3/projects/b5da2ae4b935419bb515f4e597cf7cdb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:51.840215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44db468-cf05-448e-a240-2c7fa37aafe5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:51.840215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44db468-cf05-448e-a240-2c7fa37aafe5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:51.840215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44db468-cf05-448e-a240-2c7fa37aafe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:51.857607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d44db468-cf05-448e-a240-2c7fa37aafe5 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:51.858850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d44db468-cf05-448e-a240-2c7fa37aafe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:51.906295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:51.921676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1259/2511] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:51.929351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac37a8-2a87-4950-89f7-64eca08556b4 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:51.929671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac37a8-2a87-4950-89f7-64eca08556b4 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:51.930020 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac37a8-2a87-4950-89f7-64eca08556b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:51.951354 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-48ac37a8-2a87-4950-89f7-64eca08556b4 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:51.952591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-48ac37a8-2a87-4950-89f7-64eca08556b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:51.960621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1253/2512] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:51.964835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44db468-cf05-448e-a240-2c7fa37aafe5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:51.974497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44db468-cf05-448e-a240-2c7fa37aafe5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:51.979353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:51.980542 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:51.980834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:51.981118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:51.981849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:24:51.982306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:51.989224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:51.997041 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1260/2513] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:24:52.001552 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac37a8-2a87-4950-89f7-64eca08556b4 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:52.010860 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac37a8-2a87-4950-89f7-64eca08556b4 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:52.015798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e420-e559-4e30-b62c-11da6a2aebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:52.016457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e420-e559-4e30-b62c-11da6a2aebed admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.016747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e420-e559-4e30-b62c-11da6a2aebed admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.017025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e420-e559-4e30-b62c-11da6a2aebed admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.017714 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137e420-e559-4e30-b62c-11da6a2aebed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:52.019881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137e420-e559-4e30-b62c-11da6a2aebed admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:52.144932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1254/2514] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:24:52 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:52.149168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:52.159654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5c229-097f-4fce-828e-f0989d478fc2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:52.218108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ae1e5-22b6-4d35-a740-dda7d813c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:52.218782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae1e5-22b6-4d35-a740-dda7d813c01b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.219071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae1e5-22b6-4d35-a740-dda7d813c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.219353 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae1e5-22b6-4d35-a740-dda7d813c01b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.220053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ae1e5-22b6-4d35-a740-dda7d813c01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:52.222019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ae1e5-22b6-4d35-a740-dda7d813c01b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:52.328502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1261/2515] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:24:52 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:24:52.332705 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e420-e559-4e30-b62c-11da6a2aebed admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:52.344547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e420-e559-4e30-b62c-11da6a2aebed admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:52.349457 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f133c-c06e-4c8b-b3c9-8a17de38561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:52.350194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f133c-c06e-4c8b-b3c9-8a17de38561f admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.350482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f133c-c06e-4c8b-b3c9-8a17de38561f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.350760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f133c-c06e-4c8b-b3c9-8a17de38561f admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.351514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f133c-c06e-4c8b-b3c9-8a17de38561f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:52.353107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f133c-c06e-4c8b-b3c9-8a17de38561f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:52.364401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1255/2516] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:52.368456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ae1e5-22b6-4d35-a740-dda7d813c01b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:52.378939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ae1e5-22b6-4d35-a740-dda7d813c01b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:52.383527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e7045-9d7e-4935-8fad-5b355c04130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:52.384184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e7045-9d7e-4935-8fad-5b355c04130f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.384473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e7045-9d7e-4935-8fad-5b355c04130f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.384751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e7045-9d7e-4935-8fad-5b355c04130f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.385478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e7045-9d7e-4935-8fad-5b355c04130f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:52.387110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e7045-9d7e-4935-8fad-5b355c04130f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:52.398680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1262/2517] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:52.403595 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f133c-c06e-4c8b-b3c9-8a17de38561f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:52.413894 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f133c-c06e-4c8b-b3c9-8a17de38561f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:52.419920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619858fb-ec2b-4117-acc0-89ba7717034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:52.420808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619858fb-ec2b-4117-acc0-89ba7717034d admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.421098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619858fb-ec2b-4117-acc0-89ba7717034d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.421376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619858fb-ec2b-4117-acc0-89ba7717034d admin admin] PATH_INFO: `/v3/projects/adce72a5f90d4627b2f8ed6d9b4015ff/users/f00179ef4ac84b7ca641477da296358d/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.424785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:52.436400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619858fb-ec2b-4117-acc0-89ba7717034d admin admin] RBAC: Authorizing `identity:create_grant(project_id=adce72a5f90d4627b2f8ed6d9b4015ff, user_id=f00179ef4ac84b7ca641477da296358d, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:52.442392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619858fb-ec2b-4117-acc0-89ba7717034d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:52.557694 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1256/2518] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:52 2022] PUT /identity/v3/projects/adce72a5f90d4627b2f8ed6d9b4015ff/users/f00179ef4ac84b7ca641477da296358d/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:24:52.568293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea681a7-02f2-4080-8f8e-2e75108ec763 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.568591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea681a7-02f2-4080-8f8e-2e75108ec763 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.568874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea681a7-02f2-4080-8f8e-2e75108ec763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.596062 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2ea681a7-02f2-4080-8f8e-2e75108ec763 None None] MFA Rules not processed for user `f00179ef4ac84b7ca641477da296358d`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:52.597300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2ea681a7-02f2-4080-8f8e-2e75108ec763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:52.661382 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1263/2519] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:52.665981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619858fb-ec2b-4117-acc0-89ba7717034d admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:52.735878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619858fb-ec2b-4117-acc0-89ba7717034d admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:52.741148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889cca3-bc9a-4044-88b8-e9dcd76b5f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:52.741821 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889cca3-bc9a-4044-88b8-e9dcd76b5f99 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.742149 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889cca3-bc9a-4044-88b8-e9dcd76b5f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.742437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889cca3-bc9a-4044-88b8-e9dcd76b5f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.743365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889cca3-bc9a-4044-88b8-e9dcd76b5f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:52.745983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889cca3-bc9a-4044-88b8-e9dcd76b5f99 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:52.821765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1257/2520] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:24:52 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:52.825924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea681a7-02f2-4080-8f8e-2e75108ec763 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:52.836975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea681a7-02f2-4080-8f8e-2e75108ec763 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:52.880661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:52.892879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c96d3-c075-422e-9dc1-e86a5ec73afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:52.893546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c96d3-c075-422e-9dc1-e86a5ec73afe admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.893832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c96d3-c075-422e-9dc1-e86a5ec73afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.894152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c96d3-c075-422e-9dc1-e86a5ec73afe admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.894835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c96d3-c075-422e-9dc1-e86a5ec73afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:52.896773 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c96d3-c075-422e-9dc1-e86a5ec73afe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:52.974574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1264/2521] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:24:52 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:24:52.978641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889cca3-bc9a-4044-88b8-e9dcd76b5f99 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:52.989773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889cca3-bc9a-4044-88b8-e9dcd76b5f99 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:52.994481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b8c6b-8c44-4302-b911-489bbd4379a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:52.995140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8c6b-8c44-4302-b911-489bbd4379a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:52.995431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8c6b-8c44-4302-b911-489bbd4379a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:52.995797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b8c6b-8c44-4302-b911-489bbd4379a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:52.996466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b8c6b-8c44-4302-b911-489bbd4379a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:52.998130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b8c6b-8c44-4302-b911-489bbd4379a5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:53.009108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1258/2522] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:53.013458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c96d3-c075-422e-9dc1-e86a5ec73afe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:53.023604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c96d3-c075-422e-9dc1-e86a5ec73afe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:53.028801 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61911-cd34-4c13-913d-f237f3dddfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:53.029686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61911-cd34-4c13-913d-f237f3dddfef admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:53.030266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61911-cd34-4c13-913d-f237f3dddfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:53.030549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61911-cd34-4c13-913d-f237f3dddfef admin admin] PATH_INFO: `/v3/projects/cba505cae04c44789f04ef8dd344f86a/users/457fc1131bed4c96bbfc7ba98a9206fa/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:53.045849 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61911-cd34-4c13-913d-f237f3dddfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba505cae04c44789f04ef8dd344f86a, user_id=457fc1131bed4c96bbfc7ba98a9206fa, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:53.048558 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61911-cd34-4c13-913d-f237f3dddfef admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:53.134436 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1265/2523] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:53 2022] PUT /identity/v3/projects/cba505cae04c44789f04ef8dd344f86a/users/457fc1131bed4c96bbfc7ba98a9206fa/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:53.138601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b8c6b-8c44-4302-b911-489bbd4379a5 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:53.148789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b8c6b-8c44-4302-b911-489bbd4379a5 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:53.204044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e345-d2a9-4285-9de8-b3e018d76d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:53.204708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e345-d2a9-4285-9de8-b3e018d76d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:53.205016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e345-d2a9-4285-9de8-b3e018d76d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:53.205296 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e345-d2a9-4285-9de8-b3e018d76d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:53.206040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e345-d2a9-4285-9de8-b3e018d76d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:53.207640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e345-d2a9-4285-9de8-b3e018d76d3d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:53.217778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1259/2524] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:24:53.221915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61911-cd34-4c13-913d-f237f3dddfef admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:53.235753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61911-cd34-4c13-913d-f237f3dddfef admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:53.237625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:53.238531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:53.238813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:53.239083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] PATH_INFO: `/v3/projects/cba505cae04c44789f04ef8dd344f86a/users/457fc1131bed4c96bbfc7ba98a9206fa/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:53.241031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba505cae04c44789f04ef8dd344f86a, user_id=457fc1131bed4c96bbfc7ba98a9206fa, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:53.243741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:53.253889 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1266/2525] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:24:53 2022] PUT /identity/v3/projects/cba505cae04c44789f04ef8dd344f86a/users/457fc1131bed4c96bbfc7ba98a9206fa/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:24:53.264892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1362bc-f033-43df-a3a1-4c6df9cd95c1 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:53.265190 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1362bc-f033-43df-a3a1-4c6df9cd95c1 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:53.265482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1362bc-f033-43df-a3a1-4c6df9cd95c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:53.293990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-6a1362bc-f033-43df-a3a1-4c6df9cd95c1 None None] MFA Rules not processed for user `457fc1131bed4c96bbfc7ba98a9206fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:24:53.295212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6a1362bc-f033-43df-a3a1-4c6df9cd95c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:53.338887 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:24:53.363089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1260/2526] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:24:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:24:53.373706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:53.375488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:53.434690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e74274-d060-4564-8393-817b22452f18 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:53.438601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:53.441523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:53.441523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:53.441523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:53.495870 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:53.497250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:53.506423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1267/2527] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:24:56.799872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1362bc-f033-43df-a3a1-4c6df9cd95c1 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:24:56.801327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-6a1362bc-f033-43df-a3a1-4c6df9cd95c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:24:56.814456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1362bc-f033-43df-a3a1-4c6df9cd95c1 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:24:56.819036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f2e5c-4ccb-4bb0-afeb-58bc85d59e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:24:56.819036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2e5c-4ccb-4bb0-afeb-58bc85d59e80 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:24:56.819036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2e5c-4ccb-4bb0-afeb-58bc85d59e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:24:56.819706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f2e5c-4ccb-4bb0-afeb-58bc85d59e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:24:56.829747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f2e5c-4ccb-4bb0-afeb-58bc85d59e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:24:56.831308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f2e5c-4ccb-4bb0-afeb-58bc85d59e80 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:24:56.841982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1261/2528] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:03.502397 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:06.837305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=15 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:08.381863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:08.383260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:08.442607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762951d-6147-4d31-b9d1-2058ac9119b4 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:08.448912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:08.448912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:08.448912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:08.448912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:08.451153 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:08.459450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f2e5c-4ccb-4bb0-afeb-58bc85d59e80 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:08.469895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f2e5c-4ccb-4bb0-afeb-58bc85d59e80 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:08.473774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18aaff-d518-46ae-9d28-029929938cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:08.474443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18aaff-d518-46ae-9d28-029929938cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:08.474727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18aaff-d518-46ae-9d28-029929938cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:08.475012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18aaff-d518-46ae-9d28-029929938cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:08.477889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5f18aaff-d518-46ae-9d28-029929938cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:08.512883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:08.514975 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:08.524821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1268/2529] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:08.547586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18aaff-d518-46ae-9d28-029929938cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:08.556253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18aaff-d518-46ae-9d28-029929938cd6 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:08.559698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1262/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:25:12.108334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:12.122415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f8f6-e7f0-4d28-911a-751cdeb79561 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:12.129516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:12.131009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:12.131529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:12.132011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] PATH_INFO: `/v3/users/f00179ef4ac84b7ca641477da296358d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:12.133373 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00179ef4ac84b7ca641477da296358d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:12.136146 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:12.417834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00179ef4ac84b7ca641477da296358d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:12.424881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00179ef4ac84b7ca641477da296358d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:12.528224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00179ef4ac84b7ca641477da296358d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:12.529127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00179ef4ac84b7ca641477da296358d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:12.536716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00179ef4ac84b7ca641477da296358d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:12.552665 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1269/2531] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:12 2022] DELETE /identity/v3/users/f00179ef4ac84b7ca641477da296358d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:12.557225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf80c-4cdb-44e8-9532-1821dd64ed1a None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:12.565310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf80c-4cdb-44e8-9532-1821dd64ed1a None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:12.565310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf80c-4cdb-44e8-9532-1821dd64ed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:12.577002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-edadf80c-4cdb-44e8-9532-1821dd64ed1a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:12.578317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-edadf80c-4cdb-44e8-9532-1821dd64ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:12.651140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1263/2532] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:12.661433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:12.663058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:12.698762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:12.739828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3260-a6b1-442c-8d75-c5fd40f55b6d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:12.744625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae5418-5bfe-41a5-8fb3-275ff158520c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:12.745442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae5418-5bfe-41a5-8fb3-275ff158520c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:12.745996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae5418-5bfe-41a5-8fb3-275ff158520c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:12.746193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae5418-5bfe-41a5-8fb3-275ff158520c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:12.762816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae5418-5bfe-41a5-8fb3-275ff158520c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:12.762816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae5418-5bfe-41a5-8fb3-275ff158520c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:12.775097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1270/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:14.017547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf80c-4cdb-44e8-9532-1821dd64ed1a None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:14.019718 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-edadf80c-4cdb-44e8-9532-1821dd64ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:14.051417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf80c-4cdb-44e8-9532-1821dd64ed1a None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:14.058083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:14.059469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:14.059903 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:14.060349 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] PATH_INFO: `/v3/projects/adce72a5f90d4627b2f8ed6d9b4015ff` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:14.062498 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=adce72a5f90d4627b2f8ed6d9b4015ff)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:14.065687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:14.367337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adce72a5f90d4627b2f8ed6d9b4015ff', 'request_id': 'req-915611b2-23c1-482d-a67b-189c33cfb13c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.378675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adce72a5f90d4627b2f8ed6d9b4015ff', 'request_id': 'req-915611b2-23c1-482d-a67b-189c33cfb13c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.488528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adce72a5f90d4627b2f8ed6d9b4015ff', 'request_id': 'req-915611b2-23c1-482d-a67b-189c33cfb13c'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.504491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] The token cache is being invalidate because project adce72a5f90d4627b2f8ed6d9b4015ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:14.505229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.506233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.512229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1264/2534] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:14 2022] DELETE /identity/v3/projects/adce72a5f90d4627b2f8ed6d9b4015ff => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:14.516863 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae5418-5bfe-41a5-8fb3-275ff158520c service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:14.528859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae5418-5bfe-41a5-8fb3-275ff158520c service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:14.601325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:14.602254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:14.602552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:14.602893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] PATH_INFO: `/v3/users/457fc1131bed4c96bbfc7ba98a9206fa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:14.604683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457fc1131bed4c96bbfc7ba98a9206fa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:14.606828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:14.847417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457fc1131bed4c96bbfc7ba98a9206fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.856611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457fc1131bed4c96bbfc7ba98a9206fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.977947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457fc1131bed4c96bbfc7ba98a9206fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.978713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457fc1131bed4c96bbfc7ba98a9206fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.979945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457fc1131bed4c96bbfc7ba98a9206fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:14.994698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:14.996157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:15.014983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1271/2535] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:14 2022] DELETE /identity/v3/users/457fc1131bed4c96bbfc7ba98a9206fa => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:15.017250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915611b2-23c1-482d-a67b-189c33cfb13c admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:15.040863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:15.096183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:15.097208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:15.097551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:15.097831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] PATH_INFO: `/v3/users/8d419d0520ed48b181dc528aff6364fc` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:15.099496 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d419d0520ed48b181dc528aff6364fc)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:15.101548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:15.403315 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d419d0520ed48b181dc528aff6364fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.414146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d419d0520ed48b181dc528aff6364fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.414146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d419d0520ed48b181dc528aff6364fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.414146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d419d0520ed48b181dc528aff6364fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.494617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d419d0520ed48b181dc528aff6364fc'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.517946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:15.520125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:15.523134 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1265/2536] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:14 2022] DELETE /identity/v3/users/8d419d0520ed48b181dc528aff6364fc => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:15.534856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9b59e-db5e-401a-be76-7d3f25780a07 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:15.587002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:15.626387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:15.627903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:15.628212 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:15.628628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] PATH_INFO: `/v3/projects/cba505cae04c44789f04ef8dd344f86a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:15.630068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba505cae04c44789f04ef8dd344f86a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:15.632189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:15.765072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba505cae04c44789f04ef8dd344f86a', 'request_id': 'req-08a05761-d267-4e42-ab77-b6cc2c9eb15e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.898346 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba505cae04c44789f04ef8dd344f86a', 'request_id': 'req-08a05761-d267-4e42-ab77-b6cc2c9eb15e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.906231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:15.914568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:15.914824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba505cae04c44789f04ef8dd344f86a', 'request_id': 'req-08a05761-d267-4e42-ab77-b6cc2c9eb15e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.963897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] The token cache is being invalidate because project cba505cae04c44789f04ef8dd344f86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:15.963897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.965669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3efd67-fb8b-47e3-87a3-bea0faccb580 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:15.967230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-08a05761-d267-4e42-ab77-b6cc2c9eb15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:15.967230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1272/2537] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:15 2022] DELETE /identity/v3/projects/cba505cae04c44789f04ef8dd344f86a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:15.967230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf3eb-2a01-4e0d-bfff-0c249382f6ac None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:15.967230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf3eb-2a01-4e0d-bfff-0c249382f6ac None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:15.967230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf3eb-2a01-4e0d-bfff-0c249382f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:15.993573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-dd2bf3eb-2a01-4e0d-bfff-0c249382f6ac None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:15.995724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dd2bf3eb-2a01-4e0d-bfff-0c249382f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:16.029289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:16.031886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.031886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.032194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] PATH_INFO: `/v3/projects/44bc3d12929848eda3f2a7658642d532` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.033788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] RBAC: Authorizing `identity:delete_project(project_id=44bc3d12929848eda3f2a7658642d532)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:16.037145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:16.073266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1273/2538] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:16.083865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76e2a-c276-44cd-8d9f-9df8f3060e73 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.084219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76e2a-c276-44cd-8d9f-9df8f3060e73 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.084535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76e2a-c276-44cd-8d9f-9df8f3060e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.107093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-93e76e2a-c276-44cd-8d9f-9df8f3060e73 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:16.113871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-93e76e2a-c276-44cd-8d9f-9df8f3060e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:16.117456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1274/2539] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:16.122298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76e2a-c276-44cd-8d9f-9df8f3060e73 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:16.131685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76e2a-c276-44cd-8d9f-9df8f3060e73 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:16.136338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:16.136972 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.137262 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.137545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.138296 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:16.138611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:16.140258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:16.151616 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1275/2540] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:25:16.155853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:16.164961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ac4e5-3aa7-4d7e-9e51-227ed6a909bf admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:16.170079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b114bd-926f-4af1-b4c3-915bcc62298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:16.170675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b114bd-926f-4af1-b4c3-915bcc62298f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.170966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b114bd-926f-4af1-b4c3-915bcc62298f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.171248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b114bd-926f-4af1-b4c3-915bcc62298f admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.171906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b114bd-926f-4af1-b4c3-915bcc62298f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:16.173942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b114bd-926f-4af1-b4c3-915bcc62298f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:16.475980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1276/2541] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:16 2022] POST /identity/v3/projects => generated 409 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:16.477407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b114bd-926f-4af1-b4c3-915bcc62298f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:16.519622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44bc3d12929848eda3f2a7658642d532', 'request_id': 'req-4a334e0e-9d7f-49c4-bd86-275c1a4affce'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:16.535110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44bc3d12929848eda3f2a7658642d532', 'request_id': 'req-4a334e0e-9d7f-49c4-bd86-275c1a4affce'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:16.597482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b114bd-926f-4af1-b4c3-915bcc62298f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:16.646431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44bc3d12929848eda3f2a7658642d532', 'request_id': 'req-4a334e0e-9d7f-49c4-bd86-275c1a4affce'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:16.666319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] The token cache is being invalidate because project 44bc3d12929848eda3f2a7658642d532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:16.666642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:16.667585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4a334e0e-9d7f-49c4-bd86-275c1a4affce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:16.670173 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1266/2542] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:15 2022] DELETE /identity/v3/projects/44bc3d12929848eda3f2a7658642d532 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:16.675023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d739bb-5e87-41d4-add8-260c0bf08ff0 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.675549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d739bb-5e87-41d4-add8-260c0bf08ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.676187 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d739bb-5e87-41d4-add8-260c0bf08ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.678308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d279be7-cb2f-4d52-96dd-fa8e3b37c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:16.680720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d279be7-cb2f-4d52-96dd-fa8e3b37c841 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.681920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d279be7-cb2f-4d52-96dd-fa8e3b37c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.685649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d279be7-cb2f-4d52-96dd-fa8e3b37c841 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.685649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d279be7-cb2f-4d52-96dd-fa8e3b37c841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:16.689478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d279be7-cb2f-4d52-96dd-fa8e3b37c841 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:16.710237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-e8d739bb-5e87-41d4-add8-260c0bf08ff0 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:16.714312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e8d739bb-5e87-41d4-add8-260c0bf08ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:16.722033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1267/2543] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:16.730201 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411b073-acf4-44cd-8261-aeec6eb9b024 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.732467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411b073-acf4-44cd-8261-aeec6eb9b024 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.733018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411b073-acf4-44cd-8261-aeec6eb9b024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.763866 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-1411b073-acf4-44cd-8261-aeec6eb9b024 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:16.767977 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1411b073-acf4-44cd-8261-aeec6eb9b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:16.775455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:16.789261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1268/2544] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:16.790202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411b073-acf4-44cd-8261-aeec6eb9b024 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:16.801240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411b073-acf4-44cd-8261-aeec6eb9b024 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:16.807202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:16.808271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.808271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.808746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.809811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:16.810212 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:16.819436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:16.848385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1269/2545] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:25:16.848763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1277/2546] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:16 2022] POST /identity/v3/users => generated 305 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:16.850908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d279be7-cb2f-4d52-96dd-fa8e3b37c841 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:16.851624 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:16.853644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:16.866802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d279be7-cb2f-4d52-96dd-fa8e3b37c841 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:16.878798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefac59-e491-4a99-b57a-d33277595912 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:16.880494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cfcb0-d973-4a26-8e48-c7a2585a2596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:16.881427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cfcb0-d973-4a26-8e48-c7a2585a2596 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.881727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cfcb0-d973-4a26-8e48-c7a2585a2596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.882165 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cfcb0-d973-4a26-8e48-c7a2585a2596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.882831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cfcb0-d973-4a26-8e48-c7a2585a2596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:16.885791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261918b7-500b-423e-9fdb-7b4078e87a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:16.886418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cfcb0-d973-4a26-8e48-c7a2585a2596 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:16.886853 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261918b7-500b-423e-9fdb-7b4078e87a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.887327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261918b7-500b-423e-9fdb-7b4078e87a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.887715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261918b7-500b-423e-9fdb-7b4078e87a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.888738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261918b7-500b-423e-9fdb-7b4078e87a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:16.905763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261918b7-500b-423e-9fdb-7b4078e87a51 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:16.942110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1270/2547] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:16.943817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261918b7-500b-423e-9fdb-7b4078e87a51 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:16.961347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261918b7-500b-423e-9fdb-7b4078e87a51 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:16.967656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a52908-6b1b-4a10-97e4-bd06c3b270b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:16.968562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a52908-6b1b-4a10-97e4-bd06c3b270b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:16.969808 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a52908-6b1b-4a10-97e4-bd06c3b270b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:16.970265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a52908-6b1b-4a10-97e4-bd06c3b270b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:16.971217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a52908-6b1b-4a10-97e4-bd06c3b270b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:16.975909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a52908-6b1b-4a10-97e4-bd06c3b270b9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:16.997311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1271/2548] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:16.998667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a52908-6b1b-4a10-97e4-bd06c3b270b9 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.025545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1278/2549] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:16 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:17.026566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a52908-6b1b-4a10-97e4-bd06c3b270b9 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.027089 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cfcb0-d973-4a26-8e48-c7a2585a2596 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.165292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54155-5f6a-4565-9bfe-0b0b345d0aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.166295 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54155-5f6a-4565-9bfe-0b0b345d0aef admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.166612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54155-5f6a-4565-9bfe-0b0b345d0aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.166932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54155-5f6a-4565-9bfe-0b0b345d0aef admin admin] PATH_INFO: `/v3/projects/9f143f8eeacb4b47850db956b8f3fea5/users/7a804e5768cc4cf5ab739ee0c1473b2c/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.190392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54155-5f6a-4565-9bfe-0b0b345d0aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f143f8eeacb4b47850db956b8f3fea5, user_id=7a804e5768cc4cf5ab739ee0c1473b2c, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.195022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54155-5f6a-4565-9bfe-0b0b345d0aef admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.226869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cfcb0-d973-4a26-8e48-c7a2585a2596 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.233222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8584b-63f0-4faf-8e56-fcb2673537f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.233988 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8584b-63f0-4faf-8e56-fcb2673537f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.234478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8584b-63f0-4faf-8e56-fcb2673537f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.234766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8584b-63f0-4faf-8e56-fcb2673537f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.235528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8584b-63f0-4faf-8e56-fcb2673537f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.237543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8584b-63f0-4faf-8e56-fcb2673537f8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.336290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1272/2550] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:16 2022] PUT /identity/v3/projects/9f143f8eeacb4b47850db956b8f3fea5/users/7a804e5768cc4cf5ab739ee0c1473b2c/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:17.348357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea09bc9-635d-4f96-add1-be56003d4d7e None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.348766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea09bc9-635d-4f96-add1-be56003d4d7e None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.349026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea09bc9-635d-4f96-add1-be56003d4d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.380159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1279/2551] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:17 2022] POST /identity/v3/users => generated 286 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:17.382405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8584b-63f0-4faf-8e56-fcb2673537f8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.389914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2ea09bc9-635d-4f96-add1-be56003d4d7e None None] MFA Rules not processed for user `7a804e5768cc4cf5ab739ee0c1473b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:17.391193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2ea09bc9-635d-4f96-add1-be56003d4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:17.399786 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8584b-63f0-4faf-8e56-fcb2673537f8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.502438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93bcf3-ed85-4f59-a749-82dde7d28062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.503956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93bcf3-ed85-4f59-a749-82dde7d28062 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.504356 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93bcf3-ed85-4f59-a749-82dde7d28062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.504729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93bcf3-ed85-4f59-a749-82dde7d28062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.505579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93bcf3-ed85-4f59-a749-82dde7d28062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.507568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93bcf3-ed85-4f59-a749-82dde7d28062 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.516975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1273/2552] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:17.522020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1280/2553] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:17.522218 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea09bc9-635d-4f96-add1-be56003d4d7e None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.524040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93bcf3-ed85-4f59-a749-82dde7d28062 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.537079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93bcf3-ed85-4f59-a749-82dde7d28062 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.539132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea09bc9-635d-4f96-add1-be56003d4d7e None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.542918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf662-18ac-40d0-8dc7-ff531f348036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.543586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf662-18ac-40d0-8dc7-ff531f348036 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.544292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf662-18ac-40d0-8dc7-ff531f348036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.544808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf662-18ac-40d0-8dc7-ff531f348036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.545764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaf662-18ac-40d0-8dc7-ff531f348036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.547627 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaf662-18ac-40d0-8dc7-ff531f348036 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.549939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51e035-2a37-4f7b-ac16-e50a51662cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.555262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e035-2a37-4f7b-ac16-e50a51662cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.555262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e035-2a37-4f7b-ac16-e50a51662cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.555262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e035-2a37-4f7b-ac16-e50a51662cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.555262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51e035-2a37-4f7b-ac16-e50a51662cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.555262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51e035-2a37-4f7b-ac16-e50a51662cd3 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.561007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1281/2554] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:17.565234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf662-18ac-40d0-8dc7-ff531f348036 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.586909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf662-18ac-40d0-8dc7-ff531f348036 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.592645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd85e9-89fd-4082-aa3c-1d2cbe97dc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.593669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd85e9-89fd-4082-aa3c-1d2cbe97dc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.594213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd85e9-89fd-4082-aa3c-1d2cbe97dc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.594679 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd85e9-89fd-4082-aa3c-1d2cbe97dc6c admin admin] PATH_INFO: `/v3/projects/a8aedb0c3c4443eea5c0def35f377597/users/352f95e0470b417981cfb76f162cae61/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.631303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd85e9-89fd-4082-aa3c-1d2cbe97dc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8aedb0c3c4443eea5c0def35f377597, user_id=352f95e0470b417981cfb76f162cae61, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.637101 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd85e9-89fd-4082-aa3c-1d2cbe97dc6c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.668755 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1274/2555] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:17 2022] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:17.672594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51e035-2a37-4f7b-ac16-e50a51662cd3 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.716061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1282/2556] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:17 2022] PUT /identity/v3/projects/a8aedb0c3c4443eea5c0def35f377597/users/352f95e0470b417981cfb76f162cae61/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:17.727612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166f67-1a0e-4e92-99ac-5341f66018df None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.733579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166f67-1a0e-4e92-99ac-5341f66018df None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.733579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02166f67-1a0e-4e92-99ac-5341f66018df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.736515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:17.785422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51e035-2a37-4f7b-ac16-e50a51662cd3 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.788686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-02166f67-1a0e-4e92-99ac-5341f66018df None None] MFA Rules not processed for user `352f95e0470b417981cfb76f162cae61`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:17.790227 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-02166f67-1a0e-4e92-99ac-5341f66018df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:17.846591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5bb91-4d7a-4f0c-b35e-33c59176afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.850226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5bb91-4d7a-4f0c-b35e-33c59176afc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.850226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5bb91-4d7a-4f0c-b35e-33c59176afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.850226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5bb91-4d7a-4f0c-b35e-33c59176afc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.850226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5bb91-4d7a-4f0c-b35e-33c59176afc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.850715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5bb91-4d7a-4f0c-b35e-33c59176afc7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.857684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1283/2557] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:17.862066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02166f67-1a0e-4e92-99ac-5341f66018df None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.873303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02166f67-1a0e-4e92-99ac-5341f66018df None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.878380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d7a9-9bdc-4a97-9bb1-aaeff0725cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.879503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d7a9-9bdc-4a97-9bb1-aaeff0725cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.879790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d7a9-9bdc-4a97-9bb1-aaeff0725cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.880064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d7a9-9bdc-4a97-9bb1-aaeff0725cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.880787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d7a9-9bdc-4a97-9bb1-aaeff0725cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.882954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d7a9-9bdc-4a97-9bb1-aaeff0725cc5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.921208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1275/2558] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:17 2022] POST /identity/v3/users => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:17.925060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5bb91-4d7a-4f0c-b35e-33c59176afc7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.934958 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5bb91-4d7a-4f0c-b35e-33c59176afc7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.939735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592eaa-bb2a-41a8-8182-0450758fe635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.942443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592eaa-bb2a-41a8-8182-0450758fe635 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.942443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592eaa-bb2a-41a8-8182-0450758fe635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.942443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592eaa-bb2a-41a8-8182-0450758fe635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.942443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11592eaa-bb2a-41a8-8182-0450758fe635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.943314 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11592eaa-bb2a-41a8-8182-0450758fe635 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.957441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1276/2559] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:17.958545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592eaa-bb2a-41a8-8182-0450758fe635 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:17.968748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592eaa-bb2a-41a8-8182-0450758fe635 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:17.973556 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b4a68-a1e2-4188-9ce0-7eb22ff47f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:17.974975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b4a68-a1e2-4188-9ce0-7eb22ff47f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:17.974975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b4a68-a1e2-4188-9ce0-7eb22ff47f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:17.975217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b4a68-a1e2-4188-9ce0-7eb22ff47f9f admin admin] PATH_INFO: `/v3/projects/abd62dcce411483bb53f8813856e54bd/users/5c5b38a0635348228e15ed2694d3c86e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:17.993464 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1284/2560] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:17 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:17.994291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b4a68-a1e2-4188-9ce0-7eb22ff47f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd62dcce411483bb53f8813856e54bd, user_id=5c5b38a0635348228e15ed2694d3c86e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:17.997188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b4a68-a1e2-4188-9ce0-7eb22ff47f9f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:17.999204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d7a9-9bdc-4a97-9bb1-aaeff0725cc5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.063510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d7a9-9bdc-4a97-9bb1-aaeff0725cc5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.068330 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372d25c-f835-45c8-954d-1d6f23f5cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.069009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d25c-f835-45c8-954d-1d6f23f5cfbd admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.069307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d25c-f835-45c8-954d-1d6f23f5cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.069583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d25c-f835-45c8-954d-1d6f23f5cfbd admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.070420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372d25c-f835-45c8-954d-1d6f23f5cfbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.077884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372d25c-f835-45c8-954d-1d6f23f5cfbd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.078037 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1277/2561] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:17 2022] PUT /identity/v3/projects/abd62dcce411483bb53f8813856e54bd/users/5c5b38a0635348228e15ed2694d3c86e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:18.079816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b4a68-a1e2-4188-9ce0-7eb22ff47f9f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.144976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b4a68-a1e2-4188-9ce0-7eb22ff47f9f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.147116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b7f9-09f5-4519-8931-32aaa9d20397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.148242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b7f9-09f5-4519-8931-32aaa9d20397 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.148242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b7f9-09f5-4519-8931-32aaa9d20397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.148430 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315b7f9-09f5-4519-8931-32aaa9d20397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.149072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b7f9-09f5-4519-8931-32aaa9d20397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.150749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315b7f9-09f5-4519-8931-32aaa9d20397 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.165555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1278/2562] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:18.168101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b7f9-09f5-4519-8931-32aaa9d20397 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.176183 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1285/2563] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:17 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:18.180600 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372d25c-f835-45c8-954d-1d6f23f5cfbd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.183390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315b7f9-09f5-4519-8931-32aaa9d20397 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.192342 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372d25c-f835-45c8-954d-1d6f23f5cfbd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.194079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2f805-36e6-4361-9b87-4b82d139c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.198883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a32ae-bbdf-4315-b1d8-536e040b9b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.202919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a32ae-bbdf-4315-b1d8-536e040b9b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.202919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a32ae-bbdf-4315-b1d8-536e040b9b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.202919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a32ae-bbdf-4315-b1d8-536e040b9b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.202919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a32ae-bbdf-4315-b1d8-536e040b9b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.203251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2f805-36e6-4361-9b87-4b82d139c225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.203352 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a32ae-bbdf-4315-b1d8-536e040b9b70 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.203433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2f805-36e6-4361-9b87-4b82d139c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.203433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2f805-36e6-4361-9b87-4b82d139c225 admin admin] PATH_INFO: `/v3/projects/abd62dcce411483bb53f8813856e54bd/users/5c5b38a0635348228e15ed2694d3c86e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.205289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2f805-36e6-4361-9b87-4b82d139c225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd62dcce411483bb53f8813856e54bd, user_id=5c5b38a0635348228e15ed2694d3c86e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.208630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2f805-36e6-4361-9b87-4b82d139c225 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.214110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1286/2564] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:18.218019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a32ae-bbdf-4315-b1d8-536e040b9b70 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.223337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1279/2565] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:18 2022] PUT /identity/v3/projects/abd62dcce411483bb53f8813856e54bd/users/5c5b38a0635348228e15ed2694d3c86e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:18.230333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a32ae-bbdf-4315-b1d8-536e040b9b70 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.233757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb1a8-912a-443d-b223-58b4346b98c6 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.234085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb1a8-912a-443d-b223-58b4346b98c6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.234555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bb1a8-912a-443d-b223-58b4346b98c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.272241 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5a2bb1a8-912a-443d-b223-58b4346b98c6 None None] MFA Rules not processed for user `5c5b38a0635348228e15ed2694d3c86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:18.273509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5a2bb1a8-912a-443d-b223-58b4346b98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:18.299807 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b08ddf-a3ab-4aa7-b384-56807d66fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.300770 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08ddf-a3ab-4aa7-b384-56807d66fba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.301071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08ddf-a3ab-4aa7-b384-56807d66fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.301351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08ddf-a3ab-4aa7-b384-56807d66fba6 admin admin] PATH_INFO: `/v3/projects/595f385393b74f02a63f34539a7c5c44/users/04a7a69e214c481db7b2184bab8a9298/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.320015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b08ddf-a3ab-4aa7-b384-56807d66fba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595f385393b74f02a63f34539a7c5c44, user_id=04a7a69e214c481db7b2184bab8a9298, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.324168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b08ddf-a3ab-4aa7-b384-56807d66fba6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.358192 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1280/2566] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:18 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:18.368778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bb1a8-912a-443d-b223-58b4346b98c6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.372138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5a2bb1a8-912a-443d-b223-58b4346b98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:18.427107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bb1a8-912a-443d-b223-58b4346b98c6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.430738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1287/2567] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:18 2022] PUT /identity/v3/projects/595f385393b74f02a63f34539a7c5c44/users/04a7a69e214c481db7b2184bab8a9298/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:18.445887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b08ddf-a3ab-4aa7-b384-56807d66fba6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.479532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bd3ab-b604-4b98-a95d-184d19e74ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.480234 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd3ab-b604-4b98-a95d-184d19e74ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.480525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd3ab-b604-4b98-a95d-184d19e74ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.480812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd3ab-b604-4b98-a95d-184d19e74ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.513594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b08ddf-a3ab-4aa7-b384-56807d66fba6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.518897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7d1fb-41db-4bd1-8f7b-c93110347bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.519643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7d1fb-41db-4bd1-8f7b-c93110347bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.523505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7d1fb-41db-4bd1-8f7b-c93110347bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.523505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7d1fb-41db-4bd1-8f7b-c93110347bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.523505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7d1fb-41db-4bd1-8f7b-c93110347bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.523505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7d1fb-41db-4bd1-8f7b-c93110347bd1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.533219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1288/2568] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:18.537123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7d1fb-41db-4bd1-8f7b-c93110347bd1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.541723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bd3ab-b604-4b98-a95d-184d19e74ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.543230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bd3ab-b604-4b98-a95d-184d19e74ed1 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.547621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7d1fb-41db-4bd1-8f7b-c93110347bd1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.552599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dffcd-12f1-4ae5-9239-572187c87c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.553407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dffcd-12f1-4ae5-9239-572187c87c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.553696 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dffcd-12f1-4ae5-9239-572187c87c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.554012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dffcd-12f1-4ae5-9239-572187c87c63 admin admin] PATH_INFO: `/v3/projects/595f385393b74f02a63f34539a7c5c44/users/04a7a69e214c481db7b2184bab8a9298/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.554695 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1281/2569] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:18 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:25:18.556169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dffcd-12f1-4ae5-9239-572187c87c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595f385393b74f02a63f34539a7c5c44, user_id=04a7a69e214c481db7b2184bab8a9298, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.559415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dffcd-12f1-4ae5-9239-572187c87c63 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.569925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1289/2570] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:18 2022] PUT /identity/v3/projects/595f385393b74f02a63f34539a7c5c44/users/04a7a69e214c481db7b2184bab8a9298/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:18.580730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223da10-5aec-403c-8579-04d248182648 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.589640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223da10-5aec-403c-8579-04d248182648 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.589640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223da10-5aec-403c-8579-04d248182648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.609242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4223da10-5aec-403c-8579-04d248182648 None None] MFA Rules not processed for user `04a7a69e214c481db7b2184bab8a9298`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:18.610564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4223da10-5aec-403c-8579-04d248182648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:18.680523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1282/2571] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:18.692687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dffcd-12f1-4ae5-9239-572187c87c63 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.748201 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dffcd-12f1-4ae5-9239-572187c87c63 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.752278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47727f-2208-4013-9bd0-7d7b2bf6d9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.752931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47727f-2208-4013-9bd0-7d7b2bf6d9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.753252 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47727f-2208-4013-9bd0-7d7b2bf6d9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.753534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47727f-2208-4013-9bd0-7d7b2bf6d9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.763441 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47727f-2208-4013-9bd0-7d7b2bf6d9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.765020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47727f-2208-4013-9bd0-7d7b2bf6d9b8 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:18.774379 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1290/2572] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:18.831577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:18.907929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223da10-5aec-403c-8579-04d248182648 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.909786 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4223da10-5aec-403c-8579-04d248182648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:18.922267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223da10-5aec-403c-8579-04d248182648 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.925940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.926628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.927009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.927270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.970744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47727f-2208-4013-9bd0-7d7b2bf6d9b8 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:18.981013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47727f-2208-4013-9bd0-7d7b2bf6d9b8 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:18.985145 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dfbef-21cb-4753-98d4-f135dbae5d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:18.985906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dfbef-21cb-4753-98d4-f135dbae5d44 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:18.986313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dfbef-21cb-4753-98d4-f135dbae5d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:18.986664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dfbef-21cb-4753-98d4-f135dbae5d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:18.992972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:18.995386 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:19.005834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1283/2573] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:19.067071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dfbef-21cb-4753-98d4-f135dbae5d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:19.075721 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dfbef-21cb-4753-98d4-f135dbae5d44 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:19.080331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1291/2574] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:19.612053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:20.389639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:20.486923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:20.699992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:20.757684 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:21.112980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:21.114465 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:21.171401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613752f-325d-497a-a462-137975164ac9 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:21.174997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:21.175642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:21.175927 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:21.176210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:21.178200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:21.240084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:21.241531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:21.251153 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1284/2575] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:21.275649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:23.048846 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dfbef-21cb-4753-98d4-f135dbae5d44 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:23.059693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dfbef-21cb-4753-98d4-f135dbae5d44 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:23.067740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:23.067976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:23.068269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:23.068552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:23.070574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:23.152049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:23.158487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:23.167219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1292/2576] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:24.393208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:24.401943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52ed6-38b0-49fa-82f5-f93bf2bd6827 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:24.405909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:24.408275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:24.408275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:24.408275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:24.408911 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:24.423685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:24.425144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:24.437567 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1285/2577] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:25.281452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:25.282977 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:25.297135 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c55d6-d1fd-4182-9a2a-eb31d82c6bb1 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:25.305883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:25.305883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:25.305883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:25.305883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] PATH_INFO: `/v3/users/4705101941674ef0839a6cff5d1bab2f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:25.318503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4705101941674ef0839a6cff5d1bab2f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:25.320615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:25.529933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4705101941674ef0839a6cff5d1bab2f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:25.536657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4705101941674ef0839a6cff5d1bab2f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:25.540247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:25.634747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4705101941674ef0839a6cff5d1bab2f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:25.635602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4705101941674ef0839a6cff5d1bab2f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:25.636215 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c9aa439-d5b4-4e45-b7bd-9ce59a8eddf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4705101941674ef0839a6cff5d1bab2f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:25.654163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1293/2578] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:25 2022] DELETE /identity/v3/users/4705101941674ef0839a6cff5d1bab2f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:26.053359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:26.064675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4883d-47cc-4f12-a08e-e06b06aace4f service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:26.130459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:26.131318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:26.131604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:26.131882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] PATH_INFO: `/v3/projects/c27e5dcbd9bf4393b075f9837651e5c7` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:26.142248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27e5dcbd9bf4393b075f9837651e5c7)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:26.145176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:26.306424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27e5dcbd9bf4393b075f9837651e5c7', 'request_id': 'req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:26.313198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27e5dcbd9bf4393b075f9837651e5c7', 'request_id': 'req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:26.316908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:26.417406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27e5dcbd9bf4393b075f9837651e5c7', 'request_id': 'req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:26.430051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] The token cache is being invalidate because project c27e5dcbd9bf4393b075f9837651e5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:26.430340 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:26.430997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ff430c3c-3ade-4e05-8c79-c8dc8d28bdff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:26.432544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1286/2579] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:26 2022] DELETE /identity/v3/projects/c27e5dcbd9bf4393b075f9837651e5c7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:26.437529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8d58d-4b54-4497-bd8a-cc6121e8f117 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:26.438044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8d58d-4b54-4497-bd8a-cc6121e8f117 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:26.438160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8d58d-4b54-4497-bd8a-cc6121e8f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:26.456495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c3e8d58d-4b54-4497-bd8a-cc6121e8f117 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:26.457798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c3e8d58d-4b54-4497-bd8a-cc6121e8f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:26.519866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1294/2580] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:26.528097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daa5bb-b958-4a79-b077-efc135f5c1bc None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:26.528391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daa5bb-b958-4a79-b077-efc135f5c1bc None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:26.528674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daa5bb-b958-4a79-b077-efc135f5c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:26.546334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-e8daa5bb-b958-4a79-b077-efc135f5c1bc None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:26.547684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e8daa5bb-b958-4a79-b077-efc135f5c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:26.555593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1287/2581] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:26.560026 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8d58d-4b54-4497-bd8a-cc6121e8f117 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:26.571162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8d58d-4b54-4497-bd8a-cc6121e8f117 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:26.576533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:26.577192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:26.577476 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:26.577752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:26.578511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:26.578816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:26.580427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:26.601719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1295/2582] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:25:26.601924 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daa5bb-b958-4a79-b077-efc135f5c1bc None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:26.607462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daa5bb-b958-4a79-b077-efc135f5c1bc None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:26.613865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad85a2-99e4-4b2a-84c9-c37c5e5dbb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:26.616216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad85a2-99e4-4b2a-84c9-c37c5e5dbb2b admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:26.617045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad85a2-99e4-4b2a-84c9-c37c5e5dbb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:26.618200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad85a2-99e4-4b2a-84c9-c37c5e5dbb2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:26.619096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad85a2-99e4-4b2a-84c9-c37c5e5dbb2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:26.621246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad85a2-99e4-4b2a-84c9-c37c5e5dbb2b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:26.724107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1288/2583] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:26 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:26.729322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:26.743462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80f8c2-2dde-4055-8ea0-566e6c9020d0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:26.805947 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb40770-3d39-4687-bb47-853437948d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:26.806656 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb40770-3d39-4687-bb47-853437948d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:26.806970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb40770-3d39-4687-bb47-853437948d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:26.807277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb40770-3d39-4687-bb47-853437948d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:26.807985 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb40770-3d39-4687-bb47-853437948d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:26.809927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb40770-3d39-4687-bb47-853437948d0e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:26.927327 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1296/2584] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:26 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:26.931689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad85a2-99e4-4b2a-84c9-c37c5e5dbb2b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:26.943742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad85a2-99e4-4b2a-84c9-c37c5e5dbb2b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:26.949661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82116d26-0631-437f-b899-5cb4d4edd6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:26.950375 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116d26-0631-437f-b899-5cb4d4edd6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:26.950664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116d26-0631-437f-b899-5cb4d4edd6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:26.950938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116d26-0631-437f-b899-5cb4d4edd6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:26.952033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82116d26-0631-437f-b899-5cb4d4edd6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:26.953361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82116d26-0631-437f-b899-5cb4d4edd6d0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:26.971877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1289/2585] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:26.976131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb40770-3d39-4687-bb47-853437948d0e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:26.986762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb40770-3d39-4687-bb47-853437948d0e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:26.993270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4cc83-c83c-4380-8ff6-89d54c119710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:26.993628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cc83-c83c-4380-8ff6-89d54c119710 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:26.993902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cc83-c83c-4380-8ff6-89d54c119710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:26.994746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cc83-c83c-4380-8ff6-89d54c119710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:26.995488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4cc83-c83c-4380-8ff6-89d54c119710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:26.997106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4cc83-c83c-4380-8ff6-89d54c119710 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:27.010640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1297/2586] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:27.014789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82116d26-0631-437f-b899-5cb4d4edd6d0 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:27.028069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82116d26-0631-437f-b899-5cb4d4edd6d0 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:27.034248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:27.035321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:27.035616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:27.035898 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] PATH_INFO: `/v3/projects/68e16aeddd0747a68ccd554353dcc420/users/ef153f7de94541478ca82e38de02e22d/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:27.053650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e16aeddd0747a68ccd554353dcc420, user_id=ef153f7de94541478ca82e38de02e22d, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:27.056501 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:27.169089 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1290/2587] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:27 2022] PUT /identity/v3/projects/68e16aeddd0747a68ccd554353dcc420/users/ef153f7de94541478ca82e38de02e22d/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:27.184197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d90574-9751-4310-ba3d-ddc171914699 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:27.184493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d90574-9751-4310-ba3d-ddc171914699 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:27.184798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d90574-9751-4310-ba3d-ddc171914699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:27.212328 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e4d90574-9751-4310-ba3d-ddc171914699 None None] MFA Rules not processed for user `ef153f7de94541478ca82e38de02e22d`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:27.213579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e4d90574-9751-4310-ba3d-ddc171914699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:27.246720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:27.280033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1298/2588] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:27.291732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:27.295138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:27.349765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855df9-b4d5-47f9-b17b-705395d5c6d2 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:27.353342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad52881-fc06-48a1-ad5a-e88201e34188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:27.354532 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad52881-fc06-48a1-ad5a-e88201e34188 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:27.354818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad52881-fc06-48a1-ad5a-e88201e34188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:27.355097 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad52881-fc06-48a1-ad5a-e88201e34188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:27.363402 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad52881-fc06-48a1-ad5a-e88201e34188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:27.364912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad52881-fc06-48a1-ad5a-e88201e34188 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:27.374571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1291/2589] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:28.383067 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d90574-9751-4310-ba3d-ddc171914699 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:28.384699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e4d90574-9751-4310-ba3d-ddc171914699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:28.454623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d90574-9751-4310-ba3d-ddc171914699 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:28.459107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:28.460000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:28.460406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:28.460694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] PATH_INFO: `/v3/users/7a804e5768cc4cf5ab739ee0c1473b2c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:28.461944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a804e5768cc4cf5ab739ee0c1473b2c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:28.463942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:28.722197 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a804e5768cc4cf5ab739ee0c1473b2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:28.729469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a804e5768cc4cf5ab739ee0c1473b2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:28.802333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a804e5768cc4cf5ab739ee0c1473b2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:28.802969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a804e5768cc4cf5ab739ee0c1473b2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:28.803615 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a804e5768cc4cf5ab739ee0c1473b2c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:28.822809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1299/2590] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:28 2022] DELETE /identity/v3/users/7a804e5768cc4cf5ab739ee0c1473b2c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:28.827408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20e28-85bf-470d-b631-11c1dda1b6dd None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:28.827916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20e28-85bf-470d-b631-11c1dda1b6dd None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:28.828025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20e28-85bf-470d-b631-11c1dda1b6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:28.846011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-afb20e28-85bf-470d-b631-11c1dda1b6dd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:28.847228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-afb20e28-85bf-470d-b631-11c1dda1b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:28.909288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1292/2591] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:28.919539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:28.920932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:28.981553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba4bd6-dde3-4d0c-93e4-954ad293d167 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:28.985224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac443-efe8-4637-818c-6aa0f068badf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:28.985927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac443-efe8-4637-818c-6aa0f068badf service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:28.986280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac443-efe8-4637-818c-6aa0f068badf service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:28.986548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac443-efe8-4637-818c-6aa0f068badf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:28.993670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:28.996222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eac443-efe8-4637-818c-6aa0f068badf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:28.997829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eac443-efe8-4637-818c-6aa0f068badf service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:29.007599 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1300/2592] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:29.553030 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb20e28-85bf-470d-b631-11c1dda1b6dd None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:29.555322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-afb20e28-85bf-470d-b631-11c1dda1b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:29.574565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb20e28-85bf-470d-b631-11c1dda1b6dd None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:29.579724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:29.582333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:29.582333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:29.582333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] PATH_INFO: `/v3/projects/9f143f8eeacb4b47850db956b8f3fea5` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:29.583085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f143f8eeacb4b47850db956b8f3fea5)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:29.586540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:29.612127 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:29.704108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f143f8eeacb4b47850db956b8f3fea5', 'request_id': 'req-da178d1e-6cdc-4151-b93f-aae1ae08cf98'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:29.710921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f143f8eeacb4b47850db956b8f3fea5', 'request_id': 'req-da178d1e-6cdc-4151-b93f-aae1ae08cf98'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:29.792230 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f143f8eeacb4b47850db956b8f3fea5', 'request_id': 'req-da178d1e-6cdc-4151-b93f-aae1ae08cf98'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:29.803603 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] The token cache is being invalidate because project 9f143f8eeacb4b47850db956b8f3fea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:29.803895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:29.804528 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:29.806292 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1293/2593] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:29 2022] DELETE /identity/v3/projects/9f143f8eeacb4b47850db956b8f3fea5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:29.810370 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac443-efe8-4637-818c-6aa0f068badf service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:29.824489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac443-efe8-4637-818c-6aa0f068badf service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:29.880816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:29.881693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:29.882020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:29.882329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] PATH_INFO: `/v3/users/5c5b38a0635348228e15ed2694d3c86e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:29.883560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5b38a0635348228e15ed2694d3c86e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:29.885560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:30.108313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5b38a0635348228e15ed2694d3c86e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:30.119302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5b38a0635348228e15ed2694d3c86e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:30.194646 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5b38a0635348228e15ed2694d3c86e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:30.195300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5b38a0635348228e15ed2694d3c86e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:30.195932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-43cd942d-135f-4e41-a75f-aa85387eb762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5b38a0635348228e15ed2694d3c86e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:30.214713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1301/2594] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:29 2022] DELETE /identity/v3/users/5c5b38a0635348228e15ed2694d3c86e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:30.895027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:30.897845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:30.909707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da178d1e-6cdc-4151-b93f-aae1ae08cf98 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:30.967274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:30.968164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:30.968429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:30.968708 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] PATH_INFO: `/v3/projects/abd62dcce411483bb53f8813856e54bd` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:30.970052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd62dcce411483bb53f8813856e54bd)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:30.972143 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:31.110662 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd62dcce411483bb53f8813856e54bd', 'request_id': 'req-431f2d95-284e-43ba-8bdf-d04c47f14180'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:31.116609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd62dcce411483bb53f8813856e54bd', 'request_id': 'req-431f2d95-284e-43ba-8bdf-d04c47f14180'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:31.189085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd62dcce411483bb53f8813856e54bd', 'request_id': 'req-431f2d95-284e-43ba-8bdf-d04c47f14180'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:31.200242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] The token cache is being invalidate because project abd62dcce411483bb53f8813856e54bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:31.200541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:31.201181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-431f2d95-284e-43ba-8bdf-d04c47f14180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:31.202770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1294/2595] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:30 2022] DELETE /identity/v3/projects/abd62dcce411483bb53f8813856e54bd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:31.207805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13217-af71-408d-a9a3-45ade25f4065 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.208294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13217-af71-408d-a9a3-45ade25f4065 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.208512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13217-af71-408d-a9a3-45ade25f4065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.229733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5ad13217-af71-408d-a9a3-45ade25f4065 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:31.230986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5ad13217-af71-408d-a9a3-45ade25f4065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:31.294242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1302/2596] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:31.305752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae91901-f577-4efe-bc75-05af0310b69f None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.305752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae91901-f577-4efe-bc75-05af0310b69f None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.305752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae91901-f577-4efe-bc75-05af0310b69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.322065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5ae91901-f577-4efe-bc75-05af0310b69f None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:31.323319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5ae91901-f577-4efe-bc75-05af0310b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:31.331997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1295/2597] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:31.336114 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad13217-af71-408d-a9a3-45ade25f4065 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:31.346523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad13217-af71-408d-a9a3-45ade25f4065 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:31.351688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:31.352341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.352633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.352916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.353643 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:31.354039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:31.356316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:31.368308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1303/2598] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:25:31.372794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae91901-f577-4efe-bc75-05af0310b69f None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:31.382844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae91901-f577-4efe-bc75-05af0310b69f None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:31.387463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ffd93-9a30-424c-bf1c-e503f85de486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:31.388118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ffd93-9a30-424c-bf1c-e503f85de486 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.388407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ffd93-9a30-424c-bf1c-e503f85de486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.388690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ffd93-9a30-424c-bf1c-e503f85de486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.389401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ffd93-9a30-424c-bf1c-e503f85de486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:31.391365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ffd93-9a30-424c-bf1c-e503f85de486 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:31.482908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1296/2599] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:31 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:31.487110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:31.492341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:31.497523 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a106a-ed4a-4e73-9f6d-ae77a896a71a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:31.553097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac5f38-26a6-4460-85db-2a64a4dfce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:31.553780 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac5f38-26a6-4460-85db-2a64a4dfce8f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.554104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac5f38-26a6-4460-85db-2a64a4dfce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.554387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac5f38-26a6-4460-85db-2a64a4dfce8f admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.555107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac5f38-26a6-4460-85db-2a64a4dfce8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:31.557077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac5f38-26a6-4460-85db-2a64a4dfce8f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:31.659040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1304/2600] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:31 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:31.663138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ffd93-9a30-424c-bf1c-e503f85de486 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:31.673608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ffd93-9a30-424c-bf1c-e503f85de486 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:31.678208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb2d53-292b-4412-af09-5ecb1ab075fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:31.678867 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb2d53-292b-4412-af09-5ecb1ab075fa admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.679228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb2d53-292b-4412-af09-5ecb1ab075fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.679489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb2d53-292b-4412-af09-5ecb1ab075fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.680209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb2d53-292b-4412-af09-5ecb1ab075fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:31.681804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb2d53-292b-4412-af09-5ecb1ab075fa admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:31.687423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:31.693012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1297/2601] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:31.697046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac5f38-26a6-4460-85db-2a64a4dfce8f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:31.707519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac5f38-26a6-4460-85db-2a64a4dfce8f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:31.712209 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e6c83-7449-4098-9519-6d9b956e3915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:31.713899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6c83-7449-4098-9519-6d9b956e3915 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.713899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6c83-7449-4098-9519-6d9b956e3915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.714127 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6c83-7449-4098-9519-6d9b956e3915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.714814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e6c83-7449-4098-9519-6d9b956e3915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:31.716402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e6c83-7449-4098-9519-6d9b956e3915 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:31.726185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1305/2602] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:31.730196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb2d53-292b-4412-af09-5ecb1ab075fa admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:31.740351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb2d53-292b-4412-af09-5ecb1ab075fa admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:31.745105 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be262086-3222-4f9f-a99d-ce8cd870b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:31.746063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262086-3222-4f9f-a99d-ce8cd870b90c admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.746358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262086-3222-4f9f-a99d-ce8cd870b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.746639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262086-3222-4f9f-a99d-ce8cd870b90c admin admin] PATH_INFO: `/v3/projects/54da61b944f0475197a6f542e9eb9bf0/users/a1f011444b3f4ebd92f255b2f75636a5/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.763021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262086-3222-4f9f-a99d-ce8cd870b90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54da61b944f0475197a6f542e9eb9bf0, user_id=a1f011444b3f4ebd92f255b2f75636a5, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:31.765685 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262086-3222-4f9f-a99d-ce8cd870b90c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:31.865053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1298/2603] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:31 2022] PUT /identity/v3/projects/54da61b944f0475197a6f542e9eb9bf0/users/a1f011444b3f4ebd92f255b2f75636a5/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:31.876230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0dbd-503c-4307-83ec-3af601ceedf7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:31.876528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0dbd-503c-4307-83ec-3af601ceedf7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:31.876814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0dbd-503c-4307-83ec-3af601ceedf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:31.905396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fbdd0dbd-503c-4307-83ec-3af601ceedf7 None None] MFA Rules not processed for user `a1f011444b3f4ebd92f255b2f75636a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:31.906661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fbdd0dbd-503c-4307-83ec-3af601ceedf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:31.986728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1306/2604] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:31.987565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be262086-3222-4f9f-a99d-ce8cd870b90c admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:32.052677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be262086-3222-4f9f-a99d-ce8cd870b90c admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:32.058159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d62dfe-aa0b-4cf8-a0b2-44431b071b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:32.058827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62dfe-aa0b-4cf8-a0b2-44431b071b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:32.059122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62dfe-aa0b-4cf8-a0b2-44431b071b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:32.059408 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d62dfe-aa0b-4cf8-a0b2-44431b071b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:32.060107 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d62dfe-aa0b-4cf8-a0b2-44431b071b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:32.062109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d62dfe-aa0b-4cf8-a0b2-44431b071b25 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:32.156214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1299/2605] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:31 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:32.160369 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd0dbd-503c-4307-83ec-3af601ceedf7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:32.171171 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd0dbd-503c-4307-83ec-3af601ceedf7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:32.231001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab185dd-6eff-4703-84a9-2e2f3169f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:32.231678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab185dd-6eff-4703-84a9-2e2f3169f4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:32.231969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab185dd-6eff-4703-84a9-2e2f3169f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:32.232256 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab185dd-6eff-4703-84a9-2e2f3169f4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:32.232945 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab185dd-6eff-4703-84a9-2e2f3169f4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:32.234961 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab185dd-6eff-4703-84a9-2e2f3169f4f3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:32.403744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:32.409308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1307/2606] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:32 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:32.413344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d62dfe-aa0b-4cf8-a0b2-44431b071b25 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:32.424279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d62dfe-aa0b-4cf8-a0b2-44431b071b25 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:32.429307 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6e67-a633-4281-b352-9146d01eb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:32.429584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6e67-a633-4281-b352-9146d01eb014 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:32.429877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6e67-a633-4281-b352-9146d01eb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:32.430193 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6e67-a633-4281-b352-9146d01eb014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:32.430920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed6e67-a633-4281-b352-9146d01eb014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:32.433205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed6e67-a633-4281-b352-9146d01eb014 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:32.444003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1300/2607] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:32.448317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab185dd-6eff-4703-84a9-2e2f3169f4f3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:32.458728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab185dd-6eff-4703-84a9-2e2f3169f4f3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:32.463339 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773c89d-39f0-4e66-a94f-b60856ed03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:32.464285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c89d-39f0-4e66-a94f-b60856ed03cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:32.464571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c89d-39f0-4e66-a94f-b60856ed03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:32.464848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c89d-39f0-4e66-a94f-b60856ed03cb admin admin] PATH_INFO: `/v3/projects/21e90f4b9b2040af8b3a982f1a68e76a/users/1763a840948549e6ac03ac9dfa12e7cd/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:32.479916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773c89d-39f0-4e66-a94f-b60856ed03cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e90f4b9b2040af8b3a982f1a68e76a, user_id=1763a840948549e6ac03ac9dfa12e7cd, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:32.482640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773c89d-39f0-4e66-a94f-b60856ed03cb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:32.568236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1308/2608] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:32 2022] PUT /identity/v3/projects/21e90f4b9b2040af8b3a982f1a68e76a/users/1763a840948549e6ac03ac9dfa12e7cd/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:32.572889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6e67-a633-4281-b352-9146d01eb014 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:32.584053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6e67-a633-4281-b352-9146d01eb014 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:32.654951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650161bb-582e-4e7b-b981-498729dbf6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:32.655642 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650161bb-582e-4e7b-b981-498729dbf6fc admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:32.655935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650161bb-582e-4e7b-b981-498729dbf6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:32.656214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650161bb-582e-4e7b-b981-498729dbf6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:32.656949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650161bb-582e-4e7b-b981-498729dbf6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:32.658609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650161bb-582e-4e7b-b981-498729dbf6fc admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:32.671635 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1301/2609] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:32.677604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773c89d-39f0-4e66-a94f-b60856ed03cb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:32.691768 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773c89d-39f0-4e66-a94f-b60856ed03cb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:32.696591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:32.697538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:32.697830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:32.698453 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] PATH_INFO: `/v3/projects/21e90f4b9b2040af8b3a982f1a68e76a/users/1763a840948549e6ac03ac9dfa12e7cd/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:32.703251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e90f4b9b2040af8b3a982f1a68e76a, user_id=1763a840948549e6ac03ac9dfa12e7cd, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:32.703251 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:32.714579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1309/2610] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:32 2022] PUT /identity/v3/projects/21e90f4b9b2040af8b3a982f1a68e76a/users/1763a840948549e6ac03ac9dfa12e7cd/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:32.724909 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfa1d0-c76b-4f9f-bcd0-fd5d47bd552c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:32.725207 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfa1d0-c76b-4f9f-bcd0-fd5d47bd552c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:32.725495 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfa1d0-c76b-4f9f-bcd0-fd5d47bd552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:32.752798 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-efcfa1d0-c76b-4f9f-bcd0-fd5d47bd552c None None] MFA Rules not processed for user `1763a840948549e6ac03ac9dfa12e7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:32.754119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-efcfa1d0-c76b-4f9f-bcd0-fd5d47bd552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:32.788823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:32.823627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1302/2611] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:32.834346 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:32.836099 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:32.894405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2be0b-e397-45dd-a6da-84377e3743d2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:32.898143 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb280b6-0d3d-459d-8f94-566e51731a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:32.898790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb280b6-0d3d-459d-8f94-566e51731a1b service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:32.899077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb280b6-0d3d-459d-8f94-566e51731a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:32.899357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb280b6-0d3d-459d-8f94-566e51731a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:32.958914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb280b6-0d3d-459d-8f94-566e51731a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:32.960403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb280b6-0d3d-459d-8f94-566e51731a1b service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:32.970631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1310/2612] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:36.206200 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfa1d0-c76b-4f9f-bcd0-fd5d47bd552c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:36.271452 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfa1d0-c76b-4f9f-bcd0-fd5d47bd552c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:36.275997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:36.276907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:36.277196 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:36.277477 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] PATH_INFO: `/v3/users/a1f011444b3f4ebd92f255b2f75636a5` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:36.279641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f011444b3f4ebd92f255b2f75636a5)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:36.282064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:36.558246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f011444b3f4ebd92f255b2f75636a5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:36.565351 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f011444b3f4ebd92f255b2f75636a5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:36.566070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f011444b3f4ebd92f255b2f75636a5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:36.566991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f011444b3f4ebd92f255b2f75636a5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:36.664649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f011444b3f4ebd92f255b2f75636a5'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:36.684009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1303/2613] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:36 2022] DELETE /identity/v3/users/a1f011444b3f4ebd92f255b2f75636a5 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:36.689409 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a74849-53b1-4409-8b88-397e924914d9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:36.689884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a74849-53b1-4409-8b88-397e924914d9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:36.690038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a74849-53b1-4409-8b88-397e924914d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:36.707049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-54a74849-53b1-4409-8b88-397e924914d9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:36.708260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-54a74849-53b1-4409-8b88-397e924914d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:36.771300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1311/2614] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:36.781833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:36.783304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:36.841749 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ebda2-ada7-488a-a546-dec48a8ba44e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:36.845986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01660a36-6611-418b-ae18-137ca383f67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:36.846667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01660a36-6611-418b-ae18-137ca383f67a service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:36.846956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01660a36-6611-418b-ae18-137ca383f67a service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:36.847619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01660a36-6611-418b-ae18-137ca383f67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:36.857608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:36.861249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01660a36-6611-418b-ae18-137ca383f67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:36.862789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01660a36-6611-418b-ae18-137ca383f67a service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:36.872462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1304/2615] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:37.336082 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a74849-53b1-4409-8b88-397e924914d9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:37.337712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-54a74849-53b1-4409-8b88-397e924914d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:37.351793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a74849-53b1-4409-8b88-397e924914d9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:37.357447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:37.358421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:37.358632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:37.359047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] PATH_INFO: `/v3/projects/54da61b944f0475197a6f542e9eb9bf0` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:37.360155 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54da61b944f0475197a6f542e9eb9bf0)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:37.368195 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:37.375241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:37.533565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54da61b944f0475197a6f542e9eb9bf0', 'request_id': 'req-ec9f57d3-911c-461a-a3d0-b744f0cab534'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:37.613185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54da61b944f0475197a6f542e9eb9bf0', 'request_id': 'req-ec9f57d3-911c-461a-a3d0-b744f0cab534'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:37.619610 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54da61b944f0475197a6f542e9eb9bf0', 'request_id': 'req-ec9f57d3-911c-461a-a3d0-b744f0cab534'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:37.631749 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] The token cache is being invalidate because project 54da61b944f0475197a6f542e9eb9bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:37.632031 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:37.632707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:37.634313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1312/2616] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:37 2022] DELETE /identity/v3/projects/54da61b944f0475197a6f542e9eb9bf0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:37.638566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01660a36-6611-418b-ae18-137ca383f67a service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:37.648181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01660a36-6611-418b-ae18-137ca383f67a service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:37.705549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:37.706488 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:37.706779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:37.707056 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] PATH_INFO: `/v3/users/1763a840948549e6ac03ac9dfa12e7cd` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:37.708367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1763a840948549e6ac03ac9dfa12e7cd)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:37.710353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:37.919081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1763a840948549e6ac03ac9dfa12e7cd'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:37.926377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1763a840948549e6ac03ac9dfa12e7cd'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:37.927068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1763a840948549e6ac03ac9dfa12e7cd'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:37.927680 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1763a840948549e6ac03ac9dfa12e7cd'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.002323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1763a840948549e6ac03ac9dfa12e7cd'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.021697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1305/2617] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:37 2022] DELETE /identity/v3/users/1763a840948549e6ac03ac9dfa12e7cd => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:38.409881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:38.411416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:38.424868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f57d3-911c-461a-a3d0-b744f0cab534 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:38.477311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:38.479023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:38.483589 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:38.484594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:38.484962 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:38.485317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] PATH_INFO: `/v3/users/ef153f7de94541478ca82e38de02e22d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:38.486815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef153f7de94541478ca82e38de02e22d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:38.489740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:38.499604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a121227-30a7-44f6-a9d0-b0b35aa163f2 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:38.504648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:38.505529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:38.505893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:38.506132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] PATH_INFO: `/v3/projects/21e90f4b9b2040af8b3a982f1a68e76a` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:38.507344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e90f4b9b2040af8b3a982f1a68e76a)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:38.509423 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:38.644264 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e90f4b9b2040af8b3a982f1a68e76a', 'request_id': 'req-b0d309ec-37a9-470f-979c-b023893ef8eb'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.644963 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef153f7de94541478ca82e38de02e22d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.650420 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e90f4b9b2040af8b3a982f1a68e76a', 'request_id': 'req-b0d309ec-37a9-470f-979c-b023893ef8eb'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.652452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef153f7de94541478ca82e38de02e22d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.699774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e90f4b9b2040af8b3a982f1a68e76a', 'request_id': 'req-b0d309ec-37a9-470f-979c-b023893ef8eb'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.705251 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:38.711579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] The token cache is being invalidate because project 21e90f4b9b2040af8b3a982f1a68e76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:38.712049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.712701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-b0d309ec-37a9-470f-979c-b023893ef8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.714476 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1306/2618] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:38 2022] DELETE /identity/v3/projects/21e90f4b9b2040af8b3a982f1a68e76a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:38.719298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac7124-68e0-45b8-840b-2f06eeac54a9 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:38.719586 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac7124-68e0-45b8-840b-2f06eeac54a9 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:38.719864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac7124-68e0-45b8-840b-2f06eeac54a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:38.735861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef153f7de94541478ca82e38de02e22d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.736492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef153f7de94541478ca82e38de02e22d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.737228 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b10a67c6-e229-4624-a266-0e21c579a892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef153f7de94541478ca82e38de02e22d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:38.740696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d0ac7124-68e0-45b8-840b-2f06eeac54a9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:38.741993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d0ac7124-68e0-45b8-840b-2f06eeac54a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:38.766767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1313/2619] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:38 2022] DELETE /identity/v3/users/ef153f7de94541478ca82e38de02e22d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:38.771136 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a10d2-e14c-4dec-a66f-40c370c5ac44 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:38.771559 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a10d2-e14c-4dec-a66f-40c370c5ac44 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:38.771996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a10d2-e14c-4dec-a66f-40c370c5ac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:38.791121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-937a10d2-e14c-4dec-a66f-40c370c5ac44 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:38.792753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-937a10d2-e14c-4dec-a66f-40c370c5ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:38.808179 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:38.808965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1307/2620] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:38.816904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4905-c269-44bf-a2d0-995d571dafb6 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:38.817289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4905-c269-44bf-a2d0-995d571dafb6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:38.817660 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4905-c269-44bf-a2d0-995d571dafb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:38.835223 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-ac8e4905-c269-44bf-a2d0-995d571dafb6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:38.836432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ac8e4905-c269-44bf-a2d0-995d571dafb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:38.856070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1314/2621] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:38.866216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a10d2-e14c-4dec-a66f-40c370c5ac44 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:38.867717 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-937a10d2-e14c-4dec-a66f-40c370c5ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:38.899124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1308/2622] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:38.903865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4905-c269-44bf-a2d0-995d571dafb6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:38.913547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4905-c269-44bf-a2d0-995d571dafb6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:38.918297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:38.919494 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:38.919781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:38.920059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:38.920779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:38.921088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:38.922726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:38.929214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a10d2-e14c-4dec-a66f-40c370c5ac44 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:38.932902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd788-620e-46e0-b114-20f031da22f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:38.933568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd788-620e-46e0-b114-20f031da22f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:38.933852 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd788-620e-46e0-b114-20f031da22f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:38.934170 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd788-620e-46e0-b114-20f031da22f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:38.934357 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1309/2623] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:25:38.938855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:38.947771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dd788-620e-46e0-b114-20f031da22f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:38.948551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0874e68-9194-4f29-8be9-1987db0818d2 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:38.949206 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dd788-620e-46e0-b114-20f031da22f2 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:38.955197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a1731-4314-49e2-a0dc-7d59a0cefaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:38.955197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1731-4314-49e2-a0dc-7d59a0cefaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:38.955197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1731-4314-49e2-a0dc-7d59a0cefaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:38.955197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1731-4314-49e2-a0dc-7d59a0cefaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:38.955618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a1731-4314-49e2-a0dc-7d59a0cefaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:38.957051 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a1731-4314-49e2-a0dc-7d59a0cefaf7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:38.959173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1315/2624] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:25:39.029684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1310/2625] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:38 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:39.033917 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd788-620e-46e0-b114-20f031da22f2 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.046200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd788-620e-46e0-b114-20f031da22f2 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.116469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca587365-3527-4e0b-b4b2-521fa18ac424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.117238 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587365-3527-4e0b-b4b2-521fa18ac424 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.117585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587365-3527-4e0b-b4b2-521fa18ac424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.124546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587365-3527-4e0b-b4b2-521fa18ac424 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.124546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca587365-3527-4e0b-b4b2-521fa18ac424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.124546 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca587365-3527-4e0b-b4b2-521fa18ac424 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.252629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1316/2626] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:39 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:39.254123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a1731-4314-49e2-a0dc-7d59a0cefaf7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.266092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a1731-4314-49e2-a0dc-7d59a0cefaf7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.270946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5beef-2e61-42b1-bb7d-3455c3670fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.273640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5beef-2e61-42b1-bb7d-3455c3670fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.273640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5beef-2e61-42b1-bb7d-3455c3670fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.273640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5beef-2e61-42b1-bb7d-3455c3670fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.273640 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5beef-2e61-42b1-bb7d-3455c3670fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.274478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5beef-2e61-42b1-bb7d-3455c3670fd9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.285467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1311/2627] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:39.289366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca587365-3527-4e0b-b4b2-521fa18ac424 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.299712 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca587365-3527-4e0b-b4b2-521fa18ac424 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.304507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.305169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.305458 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.305741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.306635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.308261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.318301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1317/2628] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:39.322366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5beef-2e61-42b1-bb7d-3455c3670fd9 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.332599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5beef-2e61-42b1-bb7d-3455c3670fd9 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.337075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c26b-f7fa-4a58-8ae1-fac0758cfbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.338110 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c26b-f7fa-4a58-8ae1-fac0758cfbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.338393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c26b-f7fa-4a58-8ae1-fac0758cfbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.338670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c26b-f7fa-4a58-8ae1-fac0758cfbf9 admin admin] PATH_INFO: `/v3/projects/97d98d1d039548a99e742a7d690ca423/users/d6e00158d1584aeb80e3dcd35343bbd1/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.353696 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515c26b-f7fa-4a58-8ae1-fac0758cfbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d98d1d039548a99e742a7d690ca423, user_id=d6e00158d1584aeb80e3dcd35343bbd1, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.356456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515c26b-f7fa-4a58-8ae1-fac0758cfbf9 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.361576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.363591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:39.378350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1689a-56eb-445b-91ea-ff964e715899 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.383437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.384301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.384622 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.385030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] PATH_INFO: `/v3/projects/68e16aeddd0747a68ccd554353dcc420` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.386325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e16aeddd0747a68ccd554353dcc420)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.388923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.454260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1312/2629] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:39 2022] PUT /identity/v3/projects/97d98d1d039548a99e742a7d690ca423/users/d6e00158d1584aeb80e3dcd35343bbd1/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:39.515908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:39.520517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66337e53-54f4-449c-8e97-7d794cfd06d5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.520809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66337e53-54f4-449c-8e97-7d794cfd06d5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.521090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66337e53-54f4-449c-8e97-7d794cfd06d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.524999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e16aeddd0747a68ccd554353dcc420', 'request_id': 'req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:39.547217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-66337e53-54f4-449c-8e97-7d794cfd06d5 None None] MFA Rules not processed for user `d6e00158d1584aeb80e3dcd35343bbd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:39.548458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-66337e53-54f4-449c-8e97-7d794cfd06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:39.561382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:39.595927 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e16aeddd0747a68ccd554353dcc420', 'request_id': 'req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:39.603000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e16aeddd0747a68ccd554353dcc420', 'request_id': 'req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:39.611873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1313/2630] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:39.614006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] The token cache is being invalidate because project 68e16aeddd0747a68ccd554353dcc420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:39.614302 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:39.614960 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5ff4823a-d3a5-4021-a46f-f46dc868ea4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:39.616238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66337e53-54f4-449c-8e97-7d794cfd06d5 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.616866 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1318/2631] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:39 2022] DELETE /identity/v3/projects/68e16aeddd0747a68ccd554353dcc420 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:39.624069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba4d6-49ca-414f-ab23-3cad226a7f86 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.624366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba4d6-49ca-414f-ab23-3cad226a7f86 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.624676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba4d6-49ca-414f-ab23-3cad226a7f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.642614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e42ba4d6-49ca-414f-ab23-3cad226a7f86 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:39.647037 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e42ba4d6-49ca-414f-ab23-3cad226a7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:39.679319 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66337e53-54f4-449c-8e97-7d794cfd06d5 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.684047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.685203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.685550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.685828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.686627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.688540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.704783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1319/2632] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:39.713424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192c938-c74a-41f3-b9a7-9975796fc3ed None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.713716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192c938-c74a-41f3-b9a7-9975796fc3ed None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.714033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192c938-c74a-41f3-b9a7-9975796fc3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.732402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f192c938-c74a-41f3-b9a7-9975796fc3ed None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:39.733603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f192c938-c74a-41f3-b9a7-9975796fc3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:39.741479 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1320/2633] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:39.745508 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192c938-c74a-41f3-b9a7-9975796fc3ed None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.755806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192c938-c74a-41f3-b9a7-9975796fc3ed None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.777481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.777481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.777481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.777481 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.777892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:39.777892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.777892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.777892 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1321/2634] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:25:39.780548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.789858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f7afd-a42e-4cc0-a6f9-3ae178122e4a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.795279 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654ad6-466b-48b5-81fa-670321ab83bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.795968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654ad6-466b-48b5-81fa-670321ab83bb admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.796261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654ad6-466b-48b5-81fa-670321ab83bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.796539 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654ad6-466b-48b5-81fa-670321ab83bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.797214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654ad6-466b-48b5-81fa-670321ab83bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.799316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654ad6-466b-48b5-81fa-670321ab83bb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.836493 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1314/2635] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:39 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:39.840344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.842130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:39.905274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c68337-920a-48b7-bc12-775b9c3ef1a2 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.910256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4195d-3644-4626-8d76-192dde9f8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.910938 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4195d-3644-4626-8d76-192dde9f8cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.911421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4195d-3644-4626-8d76-192dde9f8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.911706 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4195d-3644-4626-8d76-192dde9f8cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.912717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4195d-3644-4626-8d76-192dde9f8cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.914735 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4195d-3644-4626-8d76-192dde9f8cfb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:39.921560 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1322/2636] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:39 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:39.922581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654ad6-466b-48b5-81fa-670321ab83bb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:39.983207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654ad6-466b-48b5-81fa-670321ab83bb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:39.987828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe60e-c65e-40ab-ba20-174493788b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:39.988492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe60e-c65e-40ab-ba20-174493788b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:39.988775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe60e-c65e-40ab-ba20-174493788b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:39.989054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fe60e-c65e-40ab-ba20-174493788b93 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:39.989733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fe60e-c65e-40ab-ba20-174493788b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:39.991703 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fe60e-c65e-40ab-ba20-174493788b93 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.007837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1315/2637] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:39 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:40.011700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4195d-3644-4626-8d76-192dde9f8cfb admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.021424 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4195d-3644-4626-8d76-192dde9f8cfb admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.026018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ab72-4220-49cd-acb5-6987201106f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.026669 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ab72-4220-49cd-acb5-6987201106f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.026959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ab72-4220-49cd-acb5-6987201106f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.027262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ab72-4220-49cd-acb5-6987201106f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.031935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2ab72-4220-49cd-acb5-6987201106f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.031935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2ab72-4220-49cd-acb5-6987201106f6 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.039996 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1316/2638] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:40.044297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ab72-4220-49cd-acb5-6987201106f6 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.053676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ab72-4220-49cd-acb5-6987201106f6 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.058450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593524-8e69-48a9-849c-d3517b5f68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.059068 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593524-8e69-48a9-849c-d3517b5f68d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.060684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593524-8e69-48a9-849c-d3517b5f68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.060684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593524-8e69-48a9-849c-d3517b5f68d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.060684 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593524-8e69-48a9-849c-d3517b5f68d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.062197 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593524-8e69-48a9-849c-d3517b5f68d7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.073186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1317/2639] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:40.077075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593524-8e69-48a9-849c-d3517b5f68d7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.086490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1323/2640] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:39 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:40.089577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593524-8e69-48a9-849c-d3517b5f68d7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.091108 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe60e-c65e-40ab-ba20-174493788b93 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.094933 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558816d-6af3-45d2-9fc1-2c7b1decbdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.096155 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558816d-6af3-45d2-9fc1-2c7b1decbdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.096443 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558816d-6af3-45d2-9fc1-2c7b1decbdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.096720 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558816d-6af3-45d2-9fc1-2c7b1decbdd3 admin admin] PATH_INFO: `/v3/projects/9150753393294580a9e55b6bce184d68/users/b238fec81fd04c3191fbf739225f472d/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.100069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:40.101107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fe60e-c65e-40ab-ba20-174493788b93 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.105922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45184c7-e005-4b84-baf3-55cc8c9b3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.107282 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45184c7-e005-4b84-baf3-55cc8c9b3c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.107571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45184c7-e005-4b84-baf3-55cc8c9b3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.107847 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45184c7-e005-4b84-baf3-55cc8c9b3c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.108565 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45184c7-e005-4b84-baf3-55cc8c9b3c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.110338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45184c7-e005-4b84-baf3-55cc8c9b3c80 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.112240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558816d-6af3-45d2-9fc1-2c7b1decbdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9150753393294580a9e55b6bce184d68, user_id=b238fec81fd04c3191fbf739225f472d, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.114932 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558816d-6af3-45d2-9fc1-2c7b1decbdd3 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.120757 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1324/2641] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:40.124766 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45184c7-e005-4b84-baf3-55cc8c9b3c80 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.129724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:40.134853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45184c7-e005-4b84-baf3-55cc8c9b3c80 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.139519 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd73c4-0873-4c52-a939-84a3f2518239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.140159 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd73c4-0873-4c52-a939-84a3f2518239 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.140447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd73c4-0873-4c52-a939-84a3f2518239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.140728 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd73c4-0873-4c52-a939-84a3f2518239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.141468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd73c4-0873-4c52-a939-84a3f2518239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.143087 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd73c4-0873-4c52-a939-84a3f2518239 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.154413 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1325/2642] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:40.158216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd73c4-0873-4c52-a939-84a3f2518239 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.167443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd73c4-0873-4c52-a939-84a3f2518239 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.172590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8f49d-e3f7-4c0a-a4db-a07b1d3a319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.173439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f49d-e3f7-4c0a-a4db-a07b1d3a319f admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.173729 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f49d-e3f7-4c0a-a4db-a07b1d3a319f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.174042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f49d-e3f7-4c0a-a4db-a07b1d3a319f admin admin] PATH_INFO: `/v3/projects/d1b374fc8db64223bd0d4050ef2130e8/users/9d1e522f20974998bae73e2db5fc9a17/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.188137 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8f49d-e3f7-4c0a-a4db-a07b1d3a319f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b374fc8db64223bd0d4050ef2130e8, user_id=9d1e522f20974998bae73e2db5fc9a17, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.190875 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8f49d-e3f7-4c0a-a4db-a07b1d3a319f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.196473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1318/2643] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:40 2022] PUT /identity/v3/projects/9150753393294580a9e55b6bce184d68/users/b238fec81fd04c3191fbf739225f472d/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:40.206679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632551-8d40-40ae-bb43-59e650e03995 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.206973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632551-8d40-40ae-bb43-59e650e03995 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.207257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632551-8d40-40ae-bb43-59e650e03995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.235040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-2d632551-8d40-40ae-bb43-59e650e03995 None None] MFA Rules not processed for user `b238fec81fd04c3191fbf739225f472d`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:40.236253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2d632551-8d40-40ae-bb43-59e650e03995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:40.281261 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1326/2644] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:40 2022] PUT /identity/v3/projects/d1b374fc8db64223bd0d4050ef2130e8/users/9d1e522f20974998bae73e2db5fc9a17/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:40.290887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a938-6bc1-495d-822d-df8dd810e029 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.291472 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a938-6bc1-495d-822d-df8dd810e029 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.294934 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a938-6bc1-495d-822d-df8dd810e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.311873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1319/2645] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:40.316237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632551-8d40-40ae-bb43-59e650e03995 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.324501 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0833a938-6bc1-495d-822d-df8dd810e029 None None] MFA Rules not processed for user `9d1e522f20974998bae73e2db5fc9a17`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:40.325861 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0833a938-6bc1-495d-822d-df8dd810e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:40.385260 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632551-8d40-40ae-bb43-59e650e03995 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.404879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1327/2646] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:40.406091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833a938-6bc1-495d-822d-df8dd810e029 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.454507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b642343-4ccf-4604-a2e5-b02faa4b5aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.455186 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b642343-4ccf-4604-a2e5-b02faa4b5aef admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.455499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b642343-4ccf-4604-a2e5-b02faa4b5aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.455776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b642343-4ccf-4604-a2e5-b02faa4b5aef admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.456502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b642343-4ccf-4604-a2e5-b02faa4b5aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.458463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b642343-4ccf-4604-a2e5-b02faa4b5aef admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.480438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833a938-6bc1-495d-822d-df8dd810e029 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.486045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c777f-e757-473a-b1a9-4a878fead471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.487657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c777f-e757-473a-b1a9-4a878fead471 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.487954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c777f-e757-473a-b1a9-4a878fead471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.488237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c777f-e757-473a-b1a9-4a878fead471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.488928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c777f-e757-473a-b1a9-4a878fead471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.490881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c777f-e757-473a-b1a9-4a878fead471 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.578948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1320/2647] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:40 2022] POST /identity/v3/projects => generated 383 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:40.583084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b642343-4ccf-4604-a2e5-b02faa4b5aef admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.591512 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:40.610069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1328/2648] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:40 2022] POST /identity/v3/projects => generated 363 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:40.613601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c777f-e757-473a-b1a9-4a878fead471 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.645407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b642343-4ccf-4604-a2e5-b02faa4b5aef admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.658448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:40.675804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c777f-e757-473a-b1a9-4a878fead471 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.680681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035fdbe-6f08-4d71-84cd-c88345df6e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.681434 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035fdbe-6f08-4d71-84cd-c88345df6e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.681750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035fdbe-6f08-4d71-84cd-c88345df6e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.682196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035fdbe-6f08-4d71-84cd-c88345df6e5a admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.682906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035fdbe-6f08-4d71-84cd-c88345df6e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.685499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035fdbe-6f08-4d71-84cd-c88345df6e5a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.704209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a1dba-a605-4c89-a73b-300c22cae4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.704885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a1dba-a605-4c89-a73b-300c22cae4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.705176 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a1dba-a605-4c89-a73b-300c22cae4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.705458 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a1dba-a605-4c89-a73b-300c22cae4f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.706184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a1dba-a605-4c89-a73b-300c22cae4f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.708235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a1dba-a605-4c89-a73b-300c22cae4f7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.783648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1329/2649] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:40 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:40.787608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035fdbe-6f08-4d71-84cd-c88345df6e5a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.794773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1321/2650] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:40 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:40.796972 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a1dba-a605-4c89-a73b-300c22cae4f7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.798344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035fdbe-6f08-4d71-84cd-c88345df6e5a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.803573 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6c0a5-3f3d-4909-969d-3a969d171dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.804486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6c0a5-3f3d-4909-969d-3a969d171dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.804628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6c0a5-3f3d-4909-969d-3a969d171dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.804808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6c0a5-3f3d-4909-969d-3a969d171dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.805669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6c0a5-3f3d-4909-969d-3a969d171dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.807227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a1dba-a605-4c89-a73b-300c22cae4f7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.807359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6c0a5-3f3d-4909-969d-3a969d171dfd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.814609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a88368-91d2-4a08-8650-996b0e1a1710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.815275 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a88368-91d2-4a08-8650-996b0e1a1710 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.815571 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a88368-91d2-4a08-8650-996b0e1a1710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.815900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a88368-91d2-4a08-8650-996b0e1a1710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.816822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a88368-91d2-4a08-8650-996b0e1a1710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.818466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a88368-91d2-4a08-8650-996b0e1a1710 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.818601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1330/2651] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:40.822584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6c0a5-3f3d-4909-969d-3a969d171dfd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.832112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1322/2652] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:40.832253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6c0a5-3f3d-4909-969d-3a969d171dfd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.833024 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a88368-91d2-4a08-8650-996b0e1a1710 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.836996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde81756-e583-4352-911a-95edb41411de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.837877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81756-e583-4352-911a-95edb41411de admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.838198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81756-e583-4352-911a-95edb41411de admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.838473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81756-e583-4352-911a-95edb41411de admin admin] PATH_INFO: `/v3/projects/1da7bec2abe844f3af126a5c8f725168/users/4dd207636845404eb82adef260aa7f6e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.844100 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a88368-91d2-4a08-8650-996b0e1a1710 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:40.848739 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b56e-57a9-4b00-bfdf-8a4fce6beca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:40.849609 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b56e-57a9-4b00-bfdf-8a4fce6beca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:40.849897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b56e-57a9-4b00-bfdf-8a4fce6beca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:40.850205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b56e-57a9-4b00-bfdf-8a4fce6beca0 admin admin] PATH_INFO: `/v3/projects/be99030a2b62492283df3a38252855fa/users/defea716fa744d0c88fd7a6bcc501a3f/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:40.854172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde81756-e583-4352-911a-95edb41411de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da7bec2abe844f3af126a5c8f725168, user_id=4dd207636845404eb82adef260aa7f6e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.857504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde81756-e583-4352-911a-95edb41411de admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.866489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4b56e-57a9-4b00-bfdf-8a4fce6beca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be99030a2b62492283df3a38252855fa, user_id=defea716fa744d0c88fd7a6bcc501a3f, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:40.869124 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4b56e-57a9-4b00-bfdf-8a4fce6beca0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:40.933336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1331/2653] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:40 2022] PUT /identity/v3/projects/1da7bec2abe844f3af126a5c8f725168/users/4dd207636845404eb82adef260aa7f6e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:40.937330 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde81756-e583-4352-911a-95edb41411de admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.956157 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1323/2654] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:40 2022] PUT /identity/v3/projects/be99030a2b62492283df3a38252855fa/users/defea716fa744d0c88fd7a6bcc501a3f/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:40.960047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b56e-57a9-4b00-bfdf-8a4fce6beca0 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:40.998375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde81756-e583-4352-911a-95edb41411de admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:41.021414 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b56e-57a9-4b00-bfdf-8a4fce6beca0 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:41.026151 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c313-7fe3-47e4-a09c-54f19144bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:41.026812 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c313-7fe3-47e4-a09c-54f19144bc48 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.027263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c313-7fe3-47e4-a09c-54f19144bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.027521 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c313-7fe3-47e4-a09c-54f19144bc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.028748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2c313-7fe3-47e4-a09c-54f19144bc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:41.030628 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2c313-7fe3-47e4-a09c-54f19144bc48 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:41.040516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1324/2655] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:41.045009 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c313-7fe3-47e4-a09c-54f19144bc48 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:41.050875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:41.054593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c313-7fe3-47e4-a09c-54f19144bc48 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:41.054720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c81cd-fb16-4298-8f88-3c726084a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:41.055364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c81cd-fb16-4298-8f88-3c726084a1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.055654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c81cd-fb16-4298-8f88-3c726084a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.055940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c81cd-fb16-4298-8f88-3c726084a1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.056669 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c81cd-fb16-4298-8f88-3c726084a1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:41.058318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c81cd-fb16-4298-8f88-3c726084a1a8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:41.059838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb1949-9746-4451-9ce7-f6acdd6d09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:41.060719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1949-9746-4451-9ce7-f6acdd6d09cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.061285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1949-9746-4451-9ce7-f6acdd6d09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.061285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1949-9746-4451-9ce7-f6acdd6d09cf admin admin] PATH_INFO: `/v3/projects/be99030a2b62492283df3a38252855fa/users/defea716fa744d0c88fd7a6bcc501a3f/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.063267 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb1949-9746-4451-9ce7-f6acdd6d09cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=be99030a2b62492283df3a38252855fa, user_id=defea716fa744d0c88fd7a6bcc501a3f, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:41.071055 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb1949-9746-4451-9ce7-f6acdd6d09cf admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:41.071178 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1332/2656] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:41.073510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c81cd-fb16-4298-8f88-3c726084a1a8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:41.077545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1325/2657] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:41 2022] PUT /identity/v3/projects/be99030a2b62492283df3a38252855fa/users/defea716fa744d0c88fd7a6bcc501a3f/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:41.086843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c81cd-fb16-4298-8f88-3c726084a1a8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:41.089281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574545-059d-4efa-9d2c-2db678e67237 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.089575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574545-059d-4efa-9d2c-2db678e67237 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.089859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574545-059d-4efa-9d2c-2db678e67237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.118215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-38574545-059d-4efa-9d2c-2db678e67237 None None] MFA Rules not processed for user `defea716fa744d0c88fd7a6bcc501a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:41.121259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-38574545-059d-4efa-9d2c-2db678e67237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:41.125450 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:41.144176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7c5fa-bd11-401d-880f-0f2edf4d61fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:41.145527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c5fa-bd11-401d-880f-0f2edf4d61fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.145527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c5fa-bd11-401d-880f-0f2edf4d61fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.145750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c5fa-bd11-401d-880f-0f2edf4d61fa admin admin] PATH_INFO: `/v3/projects/1da7bec2abe844f3af126a5c8f725168/users/4dd207636845404eb82adef260aa7f6e/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.147632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7c5fa-bd11-401d-880f-0f2edf4d61fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da7bec2abe844f3af126a5c8f725168, user_id=4dd207636845404eb82adef260aa7f6e, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:41.150502 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7c5fa-bd11-401d-880f-0f2edf4d61fa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:41.160746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1333/2658] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:41 2022] PUT /identity/v3/projects/1da7bec2abe844f3af126a5c8f725168/users/4dd207636845404eb82adef260aa7f6e/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:41.172263 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd083-40c7-40fa-922c-3e7a24cbecc3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.172553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd083-40c7-40fa-922c-3e7a24cbecc3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.172834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd083-40c7-40fa-922c-3e7a24cbecc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.197504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1326/2659] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:41.201097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3bbcd083-40c7-40fa-922c-3e7a24cbecc3 None None] MFA Rules not processed for user `4dd207636845404eb82adef260aa7f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:41.204753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3bbcd083-40c7-40fa-922c-3e7a24cbecc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:41.208982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38574545-059d-4efa-9d2c-2db678e67237 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:41.210330 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-38574545-059d-4efa-9d2c-2db678e67237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:41.269272 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38574545-059d-4efa-9d2c-2db678e67237 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:41.273806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1334/2660] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:41.285336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcd083-40c7-40fa-922c-3e7a24cbecc3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:41.286720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3bbcd083-40c7-40fa-922c-3e7a24cbecc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:41.318462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:41.319281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.319551 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.319828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.321653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:41.343377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcd083-40c7-40fa-922c-3e7a24cbecc3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:41.347051 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2fe30-05ab-4c7e-8b2f-d30a6df6cd2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:41.347698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2fe30-05ab-4c7e-8b2f-d30a6df6cd2a service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.347984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2fe30-05ab-4c7e-8b2f-d30a6df6cd2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.348259 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2fe30-05ab-4c7e-8b2f-d30a6df6cd2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.357832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2fe30-05ab-4c7e-8b2f-d30a6df6cd2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:41.359310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2fe30-05ab-4c7e-8b2f-d30a6df6cd2a service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:41.369775 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1335/2661] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:25:41.370062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:41.383401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:41.385132 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:41.395040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1327/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:25:41.708266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2fe30-05ab-4c7e-8b2f-d30a6df6cd2a service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:41.716946 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2fe30-05ab-4c7e-8b2f-d30a6df6cd2a service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:41.721196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba901a-b70a-4dc4-be2a-61e4f4707604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:41.721843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba901a-b70a-4dc4-be2a-61e4f4707604 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:41.722158 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba901a-b70a-4dc4-be2a-61e4f4707604 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:41.722437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba901a-b70a-4dc4-be2a-61e4f4707604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:41.781038 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba901a-b70a-4dc4-be2a-61e4f4707604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:41.782529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba901a-b70a-4dc4-be2a-61e4f4707604 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:41.787070 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:41.791528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1336/2663] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:43.691641 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:43.700281 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a334c7-162c-44d6-8c1f-b6498cb2d7f0 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:43.703823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84397e3b-8774-4fd8-a289-30d5de7855ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:43.704454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397e3b-8774-4fd8-a289-30d5de7855ad service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:43.708094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397e3b-8774-4fd8-a289-30d5de7855ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:43.708094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84397e3b-8774-4fd8-a289-30d5de7855ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:43.764759 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84397e3b-8774-4fd8-a289-30d5de7855ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:43.766244 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84397e3b-8774-4fd8-a289-30d5de7855ad service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:43.775099 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1328/2664] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:45.401378 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba901a-b70a-4dc4-be2a-61e4f4707604 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:45.411033 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba901a-b70a-4dc4-be2a-61e4f4707604 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:45.414740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1988f61-8a33-422f-92fe-e79d82b5e8b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:45.415380 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988f61-8a33-422f-92fe-e79d82b5e8b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:45.415668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988f61-8a33-422f-92fe-e79d82b5e8b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:45.415959 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988f61-8a33-422f-92fe-e79d82b5e8b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:45.476724 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988f61-8a33-422f-92fe-e79d82b5e8b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:45.478213 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988f61-8a33-422f-92fe-e79d82b5e8b9 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:45.488325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1337/2665] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:45.906789 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84397e3b-8774-4fd8-a289-30d5de7855ad service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:45.968724 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84397e3b-8774-4fd8-a289-30d5de7855ad service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:45.973175 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:45.974075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:45.974365 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:45.974646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] PATH_INFO: `/v3/users/9d1e522f20974998bae73e2db5fc9a17` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:45.975844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1e522f20974998bae73e2db5fc9a17)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:45.977830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:46.175436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1e522f20974998bae73e2db5fc9a17'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:46.182177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1e522f20974998bae73e2db5fc9a17'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:46.182839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1e522f20974998bae73e2db5fc9a17'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:46.183523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1e522f20974998bae73e2db5fc9a17'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:46.236064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1e522f20974998bae73e2db5fc9a17'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:46.254834 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1329/2666] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:45 2022] DELETE /identity/v3/users/9d1e522f20974998bae73e2db5fc9a17 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:46.258881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af111-a45f-4913-8255-59b644d49d46 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:46.259176 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af111-a45f-4913-8255-59b644d49d46 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:46.259460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6af111-a45f-4913-8255-59b644d49d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:46.276884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ec6af111-a45f-4913-8255-59b644d49d46 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:46.278132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ec6af111-a45f-4913-8255-59b644d49d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:46.337162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1338/2667] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:46.347188 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:46.348589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:46.355393 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:46.409890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67e83a-2e9e-4bcb-b3aa-8688e5fe7bd0 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:46.414305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed02ee-8a03-4414-8687-e8aa53979b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:46.414968 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed02ee-8a03-4414-8687-e8aa53979b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:46.415259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed02ee-8a03-4414-8687-e8aa53979b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:46.415527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed02ee-8a03-4414-8687-e8aa53979b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:46.426065 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed02ee-8a03-4414-8687-e8aa53979b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:46.427513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed02ee-8a03-4414-8687-e8aa53979b46 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:46.437997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1330/2668] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:47.031048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6af111-a45f-4913-8255-59b644d49d46 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:47.043216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ec6af111-a45f-4913-8255-59b644d49d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:47.045202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6af111-a45f-4913-8255-59b644d49d46 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:47.049921 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:47.050914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:47.051211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:47.051496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] PATH_INFO: `/v3/projects/d1b374fc8db64223bd0d4050ef2130e8` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:47.052698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b374fc8db64223bd0d4050ef2130e8)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:47.054733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:47.166791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b374fc8db64223bd0d4050ef2130e8', 'request_id': 'req-e8d1d7dc-804d-4589-b37b-6ee921b31b82'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.230392 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b374fc8db64223bd0d4050ef2130e8', 'request_id': 'req-e8d1d7dc-804d-4589-b37b-6ee921b31b82'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.237912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b374fc8db64223bd0d4050ef2130e8', 'request_id': 'req-e8d1d7dc-804d-4589-b37b-6ee921b31b82'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.248084 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] The token cache is being invalidate because project d1b374fc8db64223bd0d4050ef2130e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:47.248375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.249001 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.250575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1339/2669] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:47 2022] DELETE /identity/v3/projects/d1b374fc8db64223bd0d4050ef2130e8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:47.254507 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed02ee-8a03-4414-8687-e8aa53979b46 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:47.264941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed02ee-8a03-4414-8687-e8aa53979b46 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:47.321022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:47.321891 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:47.322209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:47.322489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] PATH_INFO: `/v3/users/4dd207636845404eb82adef260aa7f6e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:47.323665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd207636845404eb82adef260aa7f6e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:47.326156 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:47.573591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd207636845404eb82adef260aa7f6e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.580949 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd207636845404eb82adef260aa7f6e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.581616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd207636845404eb82adef260aa7f6e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.582249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd207636845404eb82adef260aa7f6e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.645910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-98a20ea5-773b-4d10-bbee-0d111ad097f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd207636845404eb82adef260aa7f6e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:47.663917 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1331/2670] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:47 2022] DELETE /identity/v3/users/4dd207636845404eb82adef260aa7f6e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:48.072716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:48.075408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:48.087229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1d7dc-804d-4589-b37b-6ee921b31b82 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:48.102410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:48.144090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:48.144953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.145240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.145511 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] PATH_INFO: `/v3/projects/1da7bec2abe844f3af126a5c8f725168` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.146704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da7bec2abe844f3af126a5c8f725168)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:48.148668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:48.253879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da7bec2abe844f3af126a5c8f725168', 'request_id': 'req-6eccff2e-54df-48ae-8bca-d4becc6cbf83'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:48.344442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da7bec2abe844f3af126a5c8f725168', 'request_id': 'req-6eccff2e-54df-48ae-8bca-d4becc6cbf83'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:48.351575 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da7bec2abe844f3af126a5c8f725168', 'request_id': 'req-6eccff2e-54df-48ae-8bca-d4becc6cbf83'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:48.363396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] The token cache is being invalidate because project 1da7bec2abe844f3af126a5c8f725168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:48.363690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:48.364364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eccff2e-54df-48ae-8bca-d4becc6cbf83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:48.365919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1340/2671] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:48 2022] DELETE /identity/v3/projects/1da7bec2abe844f3af126a5c8f725168 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:48.370978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cfdb-8fae-4fa9-a010-0167286b5add None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.371450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cfdb-8fae-4fa9-a010-0167286b5add None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.371555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cfdb-8fae-4fa9-a010-0167286b5add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.389165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-9726cfdb-8fae-4fa9-a010-0167286b5add None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:48.390525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9726cfdb-8fae-4fa9-a010-0167286b5add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:48.413339 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:48.454419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1332/2672] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:48.462520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c48cb7-b920-4c84-9b1d-ed67907444a6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.462820 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c48cb7-b920-4c84-9b1d-ed67907444a6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.463154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c48cb7-b920-4c84-9b1d-ed67907444a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.482941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-51c48cb7-b920-4c84-9b1d-ed67907444a6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:48.484141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-51c48cb7-b920-4c84-9b1d-ed67907444a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:48.492354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1341/2673] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:48.496585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726cfdb-8fae-4fa9-a010-0167286b5add None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:48.507146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726cfdb-8fae-4fa9-a010-0167286b5add None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:48.511968 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:48.512625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.512916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.513199 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.513922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:48.514266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:48.516093 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:48.529361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1333/2674] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:25:48.537078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c48cb7-b920-4c84-9b1d-ed67907444a6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:48.547205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c48cb7-b920-4c84-9b1d-ed67907444a6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:48.552648 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca3ccc-5903-4bf9-aca7-ae66c4e800f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:48.561055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ccc-5903-4bf9-aca7-ae66c4e800f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.561055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ccc-5903-4bf9-aca7-ae66c4e800f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.561055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ccc-5903-4bf9-aca7-ae66c4e800f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.561055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca3ccc-5903-4bf9-aca7-ae66c4e800f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:48.561055 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca3ccc-5903-4bf9-aca7-ae66c4e800f4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:48.677853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1342/2675] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:48 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:48.682257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:48.692795 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeba525-22a5-4b02-9dbf-c92abdddaef3 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:48.750035 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aca183-accf-400f-92fd-ba0f8b949ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:48.750715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca183-accf-400f-92fd-ba0f8b949ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.751006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca183-accf-400f-92fd-ba0f8b949ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.751288 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca183-accf-400f-92fd-ba0f8b949ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.751997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aca183-accf-400f-92fd-ba0f8b949ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:48.753986 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aca183-accf-400f-92fd-ba0f8b949ef5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:48.875892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1334/2676] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:48 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:48.879771 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca3ccc-5903-4bf9-aca7-ae66c4e800f4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:48.890471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca3ccc-5903-4bf9-aca7-ae66c4e800f4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:48.895085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98a70f-d134-402e-beb3-2ef2f73bf85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:48.895762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a70f-d134-402e-beb3-2ef2f73bf85f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.896078 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a70f-d134-402e-beb3-2ef2f73bf85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.896359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98a70f-d134-402e-beb3-2ef2f73bf85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.897081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98a70f-d134-402e-beb3-2ef2f73bf85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:48.898741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98a70f-d134-402e-beb3-2ef2f73bf85f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:48.912377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1343/2677] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:48.913644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aca183-accf-400f-92fd-ba0f8b949ef5 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:48.923653 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aca183-accf-400f-92fd-ba0f8b949ef5 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:48.928359 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3032d8c-f598-4230-9e3b-8bf25d86992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:48.929012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3032d8c-f598-4230-9e3b-8bf25d86992c admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.929301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3032d8c-f598-4230-9e3b-8bf25d86992c admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.929584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3032d8c-f598-4230-9e3b-8bf25d86992c admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.930343 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3032d8c-f598-4230-9e3b-8bf25d86992c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:48.931946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3032d8c-f598-4230-9e3b-8bf25d86992c admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:48.944676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1335/2678] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:48.946428 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98a70f-d134-402e-beb3-2ef2f73bf85f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:48.957672 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98a70f-d134-402e-beb3-2ef2f73bf85f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:48.962354 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da04523-da55-4907-aa62-1b35f5907655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:48.963504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04523-da55-4907-aa62-1b35f5907655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:48.963745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04523-da55-4907-aa62-1b35f5907655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:48.963850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da04523-da55-4907-aa62-1b35f5907655 admin admin] PATH_INFO: `/v3/projects/830393e655c9468ea657406ed9308a30/users/101ce43dbb694d76b690f7458e993b36/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:48.980044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da04523-da55-4907-aa62-1b35f5907655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=830393e655c9468ea657406ed9308a30, user_id=101ce43dbb694d76b690f7458e993b36, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:48.982805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da04523-da55-4907-aa62-1b35f5907655 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:49.047980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1344/2679] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:48 2022] PUT /identity/v3/projects/830393e655c9468ea657406ed9308a30/users/101ce43dbb694d76b690f7458e993b36/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:49.058370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e5e2-c909-44ab-a005-e575171fa5da None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:49.058765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e5e2-c909-44ab-a005-e575171fa5da None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:49.059138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638e5e2-c909-44ab-a005-e575171fa5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:49.086545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-0638e5e2-c909-44ab-a005-e575171fa5da None None] MFA Rules not processed for user `101ce43dbb694d76b690f7458e993b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:49.087607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-0638e5e2-c909-44ab-a005-e575171fa5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:49.163384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1336/2680] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:49.166538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da04523-da55-4907-aa62-1b35f5907655 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:49.218189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:49.235754 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da04523-da55-4907-aa62-1b35f5907655 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:49.240932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77284b-7849-442d-add8-9dfae87b68c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:49.241630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77284b-7849-442d-add8-9dfae87b68c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:49.241914 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77284b-7849-442d-add8-9dfae87b68c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:49.242226 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77284b-7849-442d-add8-9dfae87b68c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:49.242920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77284b-7849-442d-add8-9dfae87b68c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:49.244835 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77284b-7849-442d-add8-9dfae87b68c3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:49.438537 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1345/2681] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:49 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:49.442561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638e5e2-c909-44ab-a005-e575171fa5da None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:49.454103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638e5e2-c909-44ab-a005-e575171fa5da None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:49.474235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:49.513904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e820e-26be-451f-b137-7613cade1a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:49.514648 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e820e-26be-451f-b137-7613cade1a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:49.514931 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e820e-26be-451f-b137-7613cade1a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:49.515235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e820e-26be-451f-b137-7613cade1a1e admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:49.515936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e820e-26be-451f-b137-7613cade1a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:49.518338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e820e-26be-451f-b137-7613cade1a1e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:49.640900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1337/2682] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:49 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:49.644834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77284b-7849-442d-add8-9dfae87b68c3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:49.654955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77284b-7849-442d-add8-9dfae87b68c3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:49.659658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aaaa7-59fa-437d-8459-aee145b64117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:49.660258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aaaa7-59fa-437d-8459-aee145b64117 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:49.660553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aaaa7-59fa-437d-8459-aee145b64117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:49.660831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aaaa7-59fa-437d-8459-aee145b64117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:49.661678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6aaaa7-59fa-437d-8459-aee145b64117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:49.663324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6aaaa7-59fa-437d-8459-aee145b64117 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:49.674501 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1346/2683] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:49.681469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e820e-26be-451f-b137-7613cade1a1e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:49.692058 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e820e-26be-451f-b137-7613cade1a1e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:49.696575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ec64-60a5-4a60-a7a7-daf9d72ca073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:49.705582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ec64-60a5-4a60-a7a7-daf9d72ca073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:49.705582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ec64-60a5-4a60-a7a7-daf9d72ca073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:49.705582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ec64-60a5-4a60-a7a7-daf9d72ca073 admin admin] PATH_INFO: `/v3/projects/940160a8b491431384c410e49dcfdf9e/users/a4ad9144eddf41238621fb4d2f72c784/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:49.715082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ec64-60a5-4a60-a7a7-daf9d72ca073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=940160a8b491431384c410e49dcfdf9e, user_id=a4ad9144eddf41238621fb4d2f72c784, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:49.717760 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ec64-60a5-4a60-a7a7-daf9d72ca073 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:49.807000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1338/2684] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:49 2022] PUT /identity/v3/projects/940160a8b491431384c410e49dcfdf9e/users/a4ad9144eddf41238621fb4d2f72c784/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:49.811713 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aaaa7-59fa-437d-8459-aee145b64117 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:49.821606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aaaa7-59fa-437d-8459-aee145b64117 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:49.876788 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0061c-79d8-433a-9c40-b7899c10c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:49.877460 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0061c-79d8-433a-9c40-b7899c10c3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:49.877753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0061c-79d8-433a-9c40-b7899c10c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:49.878066 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0061c-79d8-433a-9c40-b7899c10c3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:49.878824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0061c-79d8-433a-9c40-b7899c10c3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:49.880430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0061c-79d8-433a-9c40-b7899c10c3c6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:49.889953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1347/2685] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:49.894210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ec64-60a5-4a60-a7a7-daf9d72ca073 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:49.905262 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ec64-60a5-4a60-a7a7-daf9d72ca073 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:49.910034 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:49.910876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:49.911165 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:49.911446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] PATH_INFO: `/v3/projects/940160a8b491431384c410e49dcfdf9e/users/a4ad9144eddf41238621fb4d2f72c784/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:49.913394 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=940160a8b491431384c410e49dcfdf9e, user_id=a4ad9144eddf41238621fb4d2f72c784, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:49.916060 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:49.926784 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1339/2686] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:49 2022] PUT /identity/v3/projects/940160a8b491431384c410e49dcfdf9e/users/a4ad9144eddf41238621fb4d2f72c784/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:49.938184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8267-054f-42c3-ab08-38c9520fe3da None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:49.938482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8267-054f-42c3-ab08-38c9520fe3da None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:49.938765 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8267-054f-42c3-ab08-38c9520fe3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:49.964211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d65f8267-054f-42c3-ab08-38c9520fe3da None None] MFA Rules not processed for user `a4ad9144eddf41238621fb4d2f72c784`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:49.965908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d65f8267-054f-42c3-ab08-38c9520fe3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:50.039614 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1348/2687] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:50.050353 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:50.052318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:50.111000 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72620c-8161-4aa7-8541-c5c4fbc9a833 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:50.114661 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b454563-2999-414f-a427-49853af187ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:50.115305 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b454563-2999-414f-a427-49853af187ac service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:50.115588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b454563-2999-414f-a427-49853af187ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:50.115864 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b454563-2999-414f-a427-49853af187ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:50.124895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b454563-2999-414f-a427-49853af187ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:50.126396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b454563-2999-414f-a427-49853af187ac service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:50.135741 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1340/2688] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:50.198664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8267-054f-42c3-ab08-38c9520fe3da None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:50.241563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:50.261488 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8267-054f-42c3-ab08-38c9520fe3da None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:50.272366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:50.272366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:50.272366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:50.272366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] PATH_INFO: `/v3/users/101ce43dbb694d76b690f7458e993b36` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:50.272774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101ce43dbb694d76b690f7458e993b36)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:50.273691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:50.571858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101ce43dbb694d76b690f7458e993b36'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:50.578834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101ce43dbb694d76b690f7458e993b36'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:50.654253 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101ce43dbb694d76b690f7458e993b36'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:50.655104 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101ce43dbb694d76b690f7458e993b36'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:50.655718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101ce43dbb694d76b690f7458e993b36'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:50.674956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1349/2689] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:50 2022] DELETE /identity/v3/users/101ce43dbb694d76b690f7458e993b36 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:50.679327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd15d-fc09-4bfe-9827-04efcc747f37 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:50.679793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd15d-fc09-4bfe-9827-04efcc747f37 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:50.679923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd15d-fc09-4bfe-9827-04efcc747f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:50.696747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-710dd15d-fc09-4bfe-9827-04efcc747f37 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:50.697995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-710dd15d-fc09-4bfe-9827-04efcc747f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:50.758732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1341/2690] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:50.768613 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:50.770005 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:50.830999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0550fef-6dc0-43a9-a33e-b6c83b6a3376 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:50.834714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:50.835364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:50.835660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:50.835940 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:50.845805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:50.847372 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:50.857517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1350/2691] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:51.277785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dd15d-fc09-4bfe-9827-04efcc747f37 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:51.279575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-710dd15d-fc09-4bfe-9827-04efcc747f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:51.293433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dd15d-fc09-4bfe-9827-04efcc747f37 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:51.299462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:51.300520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:51.300814 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:51.301113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] PATH_INFO: `/v3/projects/830393e655c9468ea657406ed9308a30` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:51.306523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=830393e655c9468ea657406ed9308a30)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:51.306523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:51.318573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:51.384594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:51.386092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:51.399167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0c800-3973-4c9f-8bc7-0082bd774872 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:51.404668 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:51.405538 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:51.405825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:51.406131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] PATH_INFO: `/v3/users/d6e00158d1584aeb80e3dcd35343bbd1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:51.407326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e00158d1584aeb80e3dcd35343bbd1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:51.409317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:51.420344 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830393e655c9468ea657406ed9308a30', 'request_id': 'req-89f2624e-7942-4bc7-af9b-5e20c789d069'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.426674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830393e655c9468ea657406ed9308a30', 'request_id': 'req-89f2624e-7942-4bc7-af9b-5e20c789d069'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.496725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830393e655c9468ea657406ed9308a30', 'request_id': 'req-89f2624e-7942-4bc7-af9b-5e20c789d069'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.507304 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] The token cache is being invalidate because project 830393e655c9468ea657406ed9308a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:51.507583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.508213 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.509783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1342/2692] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:51 2022] DELETE /identity/v3/projects/830393e655c9468ea657406ed9308a30 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:51.513664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:51.515036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:51.578540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2624e-7942-4bc7-af9b-5e20c789d069 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:51.583270 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:51.584220 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:51.584523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:51.584802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] PATH_INFO: `/v3/users/a4ad9144eddf41238621fb4d2f72c784` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:51.586095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ad9144eddf41238621fb4d2f72c784)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:51.588017 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:51.600319 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e00158d1584aeb80e3dcd35343bbd1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.608049 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e00158d1584aeb80e3dcd35343bbd1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.609718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:51.699151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e00158d1584aeb80e3dcd35343bbd1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.699895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e00158d1584aeb80e3dcd35343bbd1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.701244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-990daeb5-4d42-4dd9-8931-5419e36b5f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e00158d1584aeb80e3dcd35343bbd1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.723420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1351/2693] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:51 2022] DELETE /identity/v3/users/d6e00158d1584aeb80e3dcd35343bbd1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:51.727825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb392f-1931-4704-8d77-54ee25cce38a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:51.728551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb392f-1931-4704-8d77-54ee25cce38a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:51.728836 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb392f-1931-4704-8d77-54ee25cce38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:51.750769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-13eb392f-1931-4704-8d77-54ee25cce38a None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:51.752404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-13eb392f-1931-4704-8d77-54ee25cce38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:51.786486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ad9144eddf41238621fb4d2f72c784'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.795237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ad9144eddf41238621fb4d2f72c784'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.795935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ad9144eddf41238621fb4d2f72c784'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.796558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ad9144eddf41238621fb4d2f72c784'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.812649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1352/2694] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:51.822294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb392f-1931-4704-8d77-54ee25cce38a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:51.823640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-13eb392f-1931-4704-8d77-54ee25cce38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:51.881468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb392f-1931-4704-8d77-54ee25cce38a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:51.885113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:51.885764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:51.886097 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:51.886387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:51.896054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:51.897023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ad9144eddf41238621fb4d2f72c784'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:51.897498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:51.907800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1353/2695] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:25:51.916317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1343/2696] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:51 2022] DELETE /identity/v3/users/a4ad9144eddf41238621fb4d2f72c784 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:52.413371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:52.414117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:52.415007 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:52.415709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:52.433425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defac2b6-bb02-4a4e-be8d-e92466afc71e service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:52.465541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:52.499361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:52.500432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:52.500731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:52.501017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] PATH_INFO: `/v3/projects/97d98d1d039548a99e742a7d690ca423` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:52.502289 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d98d1d039548a99e742a7d690ca423)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:52.504270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:52.507676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f24b-fcda-428b-a411-13b7e9047b23 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:52.513614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:52.514352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:52.514352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:52.514580 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] PATH_INFO: `/v3/projects/940160a8b491431384c410e49dcfdf9e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:52.515988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940160a8b491431384c410e49dcfdf9e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:52.518040 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:52.539895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:52.665570 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940160a8b491431384c410e49dcfdf9e', 'request_id': 'req-87d84ab0-52dc-430b-8678-35849ac23828'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.666430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d98d1d039548a99e742a7d690ca423', 'request_id': 'req-d6303f36-dcb1-46d2-bd2c-453c2b892a38'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.671616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940160a8b491431384c410e49dcfdf9e', 'request_id': 'req-87d84ab0-52dc-430b-8678-35849ac23828'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.761587 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d98d1d039548a99e742a7d690ca423', 'request_id': 'req-d6303f36-dcb1-46d2-bd2c-453c2b892a38'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.769047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d98d1d039548a99e742a7d690ca423', 'request_id': 'req-d6303f36-dcb1-46d2-bd2c-453c2b892a38'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.780237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] The token cache is being invalidate because project 97d98d1d039548a99e742a7d690ca423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:52.780528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.781166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.782745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1354/2697] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:52 2022] DELETE /identity/v3/projects/97d98d1d039548a99e742a7d690ca423 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:52.786804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:52.788086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:52.819082 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940160a8b491431384c410e49dcfdf9e', 'request_id': 'req-87d84ab0-52dc-430b-8678-35849ac23828'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.830462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] The token cache is being invalidate because project 940160a8b491431384c410e49dcfdf9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:52.830756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.831413 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87d84ab0-52dc-430b-8678-35849ac23828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:52.832956 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1344/2698] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:52 2022] DELETE /identity/v3/projects/940160a8b491431384c410e49dcfdf9e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:52.837750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f1ba7-f9a7-43e6-97be-44a2f783ccbb None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:52.838085 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f1ba7-f9a7-43e6-97be-44a2f783ccbb None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:52.838367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f1ba7-f9a7-43e6-97be-44a2f783ccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:52.850329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303f36-dcb1-46d2-bd2c-453c2b892a38 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:52.855028 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:52.855904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:52.856189 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:52.856467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] PATH_INFO: `/v3/users/b238fec81fd04c3191fbf739225f472d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:52.856811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-dc0f1ba7-f9a7-43e6-97be-44a2f783ccbb None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:52.857704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b238fec81fd04c3191fbf739225f472d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:52.858042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-dc0f1ba7-f9a7-43e6-97be-44a2f783ccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:52.859673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:52.865934 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1345/2699] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:52.874063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86468-50d1-436a-bf03-ecba331cdc9b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:52.874435 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86468-50d1-436a-bf03-ecba331cdc9b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:52.874723 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86468-50d1-436a-bf03-ecba331cdc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:52.893094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-7aa86468-50d1-436a-bf03-ecba331cdc9b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:52.897066 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7aa86468-50d1-436a-bf03-ecba331cdc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:52.903312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1346/2700] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:52.907580 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86468-50d1-436a-bf03-ecba331cdc9b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:52.916355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86468-50d1-436a-bf03-ecba331cdc9b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:52.920862 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:52.921483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:52.921773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:52.922081 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:52.922796 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:52.923108 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:52.924707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:52.936766 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1347/2701] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:25:52.940928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:52.950198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e978af-f6e0-4014-a97a-09ef4826a9bd admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:52.957679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88519f00-cfdd-444f-8a97-c393d84fda8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:52.957679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88519f00-cfdd-444f-8a97-c393d84fda8e admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:52.957679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88519f00-cfdd-444f-8a97-c393d84fda8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:52.957679 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88519f00-cfdd-444f-8a97-c393d84fda8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:52.958109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88519f00-cfdd-444f-8a97-c393d84fda8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:52.959130 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88519f00-cfdd-444f-8a97-c393d84fda8e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.064409 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1348/2702] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:52 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:53.068599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88519f00-cfdd-444f-8a97-c393d84fda8e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.100196 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b238fec81fd04c3191fbf739225f472d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.110366 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b238fec81fd04c3191fbf739225f472d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.130232 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88519f00-cfdd-444f-8a97-c393d84fda8e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:53.135421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13734a-a205-4aa4-92c6-41046fc0fa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:53.135649 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13734a-a205-4aa4-92c6-41046fc0fa4b admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.135941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13734a-a205-4aa4-92c6-41046fc0fa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.136221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13734a-a205-4aa4-92c6-41046fc0fa4b admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.136908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13734a-a205-4aa4-92c6-41046fc0fa4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:53.139417 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13734a-a205-4aa4-92c6-41046fc0fa4b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.146994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:53.183034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b238fec81fd04c3191fbf739225f472d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.183608 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b238fec81fd04c3191fbf739225f472d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.184217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b238fec81fd04c3191fbf739225f472d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.203711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1355/2703] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:52 2022] DELETE /identity/v3/users/b238fec81fd04c3191fbf739225f472d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:53.221906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1349/2704] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:53 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:53.226086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.227500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:53.259680 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:53.293640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12195f9-9fcb-427b-ba24-571feecb4238 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:53.299281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee70dc-8403-44c5-a518-90300418927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:53.299955 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee70dc-8403-44c5-a518-90300418927f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.300243 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee70dc-8403-44c5-a518-90300418927f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.300521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee70dc-8403-44c5-a518-90300418927f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.301254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee70dc-8403-44c5-a518-90300418927f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:53.302906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee70dc-8403-44c5-a518-90300418927f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.313456 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1356/2705] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:53.317602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13734a-a205-4aa4-92c6-41046fc0fa4b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.327650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13734a-a205-4aa4-92c6-41046fc0fa4b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:53.332338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3816706-5bfe-48a2-86d9-31436782b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:53.332992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3816706-5bfe-48a2-86d9-31436782b435 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.333285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3816706-5bfe-48a2-86d9-31436782b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.333575 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3816706-5bfe-48a2-86d9-31436782b435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.334356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3816706-5bfe-48a2-86d9-31436782b435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:53.335960 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3816706-5bfe-48a2-86d9-31436782b435 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.346123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1350/2706] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:53.350321 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee70dc-8403-44c5-a518-90300418927f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.360753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee70dc-8403-44c5-a518-90300418927f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:53.365520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5adbb-51f7-4521-b7ee-2e955a2851e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:53.366421 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5adbb-51f7-4521-b7ee-2e955a2851e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.366707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5adbb-51f7-4521-b7ee-2e955a2851e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.366982 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5adbb-51f7-4521-b7ee-2e955a2851e6 admin admin] PATH_INFO: `/v3/projects/cc13295ca1b04417b702b1e5163d666b/users/ed3721df486f43458a459b5d5f330d92/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.382486 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5adbb-51f7-4521-b7ee-2e955a2851e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc13295ca1b04417b702b1e5163d666b, user_id=ed3721df486f43458a459b5d5f330d92, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:53.385406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5adbb-51f7-4521-b7ee-2e955a2851e6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.470854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1357/2707] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:53 2022] PUT /identity/v3/projects/cc13295ca1b04417b702b1e5163d666b/users/ed3721df486f43458a459b5d5f330d92/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:53.480993 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fca523-5a70-4bcb-844f-beed7f09cdd7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.481298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fca523-5a70-4bcb-844f-beed7f09cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.481577 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fca523-5a70-4bcb-844f-beed7f09cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.511581 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-59fca523-5a70-4bcb-844f-beed7f09cdd7 None None] MFA Rules not processed for user `ed3721df486f43458a459b5d5f330d92`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:53.512816 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-59fca523-5a70-4bcb-844f-beed7f09cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:53.578964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1351/2708] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:53.583435 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5adbb-51f7-4521-b7ee-2e955a2851e6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.615985 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fca523-5a70-4bcb-844f-beed7f09cdd7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.617425 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-59fca523-5a70-4bcb-844f-beed7f09cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:53.672285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5adbb-51f7-4521-b7ee-2e955a2851e6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:53.678660 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712236a-09d0-4d22-8b72-b424ce37ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:53.679334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712236a-09d0-4d22-8b72-b424ce37ab35 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.679626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712236a-09d0-4d22-8b72-b424ce37ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.679913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712236a-09d0-4d22-8b72-b424ce37ab35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.680761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712236a-09d0-4d22-8b72-b424ce37ab35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:53.682772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712236a-09d0-4d22-8b72-b424ce37ab35 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.704701 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fca523-5a70-4bcb-844f-beed7f09cdd7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:53.709240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:53.710123 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.710410 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.711285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] PATH_INFO: `/v3/projects/9150753393294580a9e55b6bce184d68` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.712012 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9150753393294580a9e55b6bce184d68)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:53.714103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.752804 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1358/2709] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:53 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:53.753885 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712236a-09d0-4d22-8b72-b424ce37ab35 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.816637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712236a-09d0-4d22-8b72-b424ce37ab35 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:53.825171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9150753393294580a9e55b6bce184d68', 'request_id': 'req-96b1e45d-3f33-41cd-a284-a60dcd88d29a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.831686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9150753393294580a9e55b6bce184d68', 'request_id': 'req-96b1e45d-3f33-41cd-a284-a60dcd88d29a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.847931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:53.875496 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:53.876180 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.876478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.876753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.877445 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:53.879449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.904948 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9150753393294580a9e55b6bce184d68', 'request_id': 'req-96b1e45d-3f33-41cd-a284-a60dcd88d29a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.912464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:53.916497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] The token cache is being invalidate because project 9150753393294580a9e55b6bce184d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:53.916791 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.917445 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:53.919054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1352/2710] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:53 2022] DELETE /identity/v3/projects/9150753393294580a9e55b6bce184d68 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:53.923379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.924664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:53.936995 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1e45d-3f33-41cd-a284-a60dcd88d29a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:53.941593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:53.942470 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:53.942764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:53.943045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] PATH_INFO: `/v3/users/defea716fa744d0c88fd7a6bcc501a3f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:53.944221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=defea716fa744d0c88fd7a6bcc501a3f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:53.946205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:53.988141 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1359/2711] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:53 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:25:53.988907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:53.990568 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:54.002177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6802a-5b86-4403-a2e3-06190bc0f6ea admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:54.006970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268f95a-3a1d-4480-8c71-70b5616f9a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:54.011011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268f95a-3a1d-4480-8c71-70b5616f9a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:54.011011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268f95a-3a1d-4480-8c71-70b5616f9a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:54.011011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268f95a-3a1d-4480-8c71-70b5616f9a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:54.011011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268f95a-3a1d-4480-8c71-70b5616f9a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:54.011011 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268f95a-3a1d-4480-8c71-70b5616f9a2d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:54.021079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1360/2712] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:54.025079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268f95a-3a1d-4480-8c71-70b5616f9a2d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:54.035528 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268f95a-3a1d-4480-8c71-70b5616f9a2d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:54.043375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882543b-edd3-4396-83bc-5c8bfcbb69f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:54.043375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882543b-edd3-4396-83bc-5c8bfcbb69f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:54.043375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882543b-edd3-4396-83bc-5c8bfcbb69f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:54.043375 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882543b-edd3-4396-83bc-5c8bfcbb69f0 admin admin] PATH_INFO: `/v3/projects/a4da5a244ddb4b258ed5bdf6a1341701/users/41ec4aaa069e49f799ae49cd8fc50951/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:54.056652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882543b-edd3-4396-83bc-5c8bfcbb69f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4da5a244ddb4b258ed5bdf6a1341701, user_id=41ec4aaa069e49f799ae49cd8fc50951, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:54.059429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882543b-edd3-4396-83bc-5c8bfcbb69f0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:54.150393 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1361/2713] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:54 2022] PUT /identity/v3/projects/a4da5a244ddb4b258ed5bdf6a1341701/users/41ec4aaa069e49f799ae49cd8fc50951/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:54.154487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882543b-edd3-4396-83bc-5c8bfcbb69f0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:54.195096 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defea716fa744d0c88fd7a6bcc501a3f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:54.216454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defea716fa744d0c88fd7a6bcc501a3f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:54.217265 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defea716fa744d0c88fd7a6bcc501a3f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:54.217953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defea716fa744d0c88fd7a6bcc501a3f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:54.222400 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882543b-edd3-4396-83bc-5c8bfcbb69f0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:54.227325 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:54.232438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:54.232438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:54.232438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:54.232438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:54.232438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:54.242233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1362/2714] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:54.246221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:54.248641 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:54.261590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1acd38-71cd-43b8-bbd5-19b01094de1a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:54.266504 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e30595-4c29-4785-807d-e18827d12bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:54.267242 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30595-4c29-4785-807d-e18827d12bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:54.267527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30595-4c29-4785-807d-e18827d12bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:54.267805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30595-4c29-4785-807d-e18827d12bd3 admin admin] PATH_INFO: `/v3/projects/a4da5a244ddb4b258ed5bdf6a1341701/users/41ec4aaa069e49f799ae49cd8fc50951/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:54.269797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e30595-4c29-4785-807d-e18827d12bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4da5a244ddb4b258ed5bdf6a1341701, user_id=41ec4aaa069e49f799ae49cd8fc50951, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:54.272466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e30595-4c29-4785-807d-e18827d12bd3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:54.283040 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1363/2715] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:54 2022] PUT /identity/v3/projects/a4da5a244ddb4b258ed5bdf6a1341701/users/41ec4aaa069e49f799ae49cd8fc50951/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:54.299745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47053e-cdcb-4f3f-a90c-681859f866b0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:54.300075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47053e-cdcb-4f3f-a90c-681859f866b0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:54.300361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47053e-cdcb-4f3f-a90c-681859f866b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:54.327459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3c47053e-cdcb-4f3f-a90c-681859f866b0 None None] MFA Rules not processed for user `41ec4aaa069e49f799ae49cd8fc50951`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:54.328670 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3c47053e-cdcb-4f3f-a90c-681859f866b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:54.331950 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defea716fa744d0c88fd7a6bcc501a3f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:54.354387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1353/2716] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:25:53 2022] DELETE /identity/v3/users/defea716fa744d0c88fd7a6bcc501a3f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:54.398978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:54.410521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1364/2717] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:25:54.422517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:54.424233 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:54.487317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77a8b3-4743-493e-b706-7dd728243b3b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:54.491367 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:54.492062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:54.492349 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:54.492622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:54.552352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:54.553802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:54.563453 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1354/2718] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:54.761607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47053e-cdcb-4f3f-a90c-681859f866b0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:54.816580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47053e-cdcb-4f3f-a90c-681859f866b0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:54.820248 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8146a9-9fd1-4786-8d55-d5ae60f4b2f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:54.820902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8146a9-9fd1-4786-8d55-d5ae60f4b2f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:54.821455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8146a9-9fd1-4786-8d55-d5ae60f4b2f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:54.821995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8146a9-9fd1-4786-8d55-d5ae60f4b2f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:54.822639 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:54.823735 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb8146a9-9fd1-4786-8d55-d5ae60f4b2f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:54.824240 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:54.853844 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:54.889267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8146a9-9fd1-4786-8d55-d5ae60f4b2f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:54.890756 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8146a9-9fd1-4786-8d55-d5ae60f4b2f0 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:54.895776 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade4365-1c94-4df3-9599-b804e8fc61be service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:54.900507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1365/2719] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:25:54.900780 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:54.901655 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:54.901984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:54.902302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] PATH_INFO: `/v3/projects/be99030a2b62492283df3a38252855fa` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:54.903530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be99030a2b62492283df3a38252855fa)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:54.906287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:55.006919 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be99030a2b62492283df3a38252855fa', 'request_id': 'req-153fd113-34d6-4dee-8991-67112b4bc62f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:55.013793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be99030a2b62492283df3a38252855fa', 'request_id': 'req-153fd113-34d6-4dee-8991-67112b4bc62f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:55.102620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be99030a2b62492283df3a38252855fa', 'request_id': 'req-153fd113-34d6-4dee-8991-67112b4bc62f'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:55.113703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] The token cache is being invalidate because project be99030a2b62492283df3a38252855fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:25:55.114042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:55.114736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-153fd113-34d6-4dee-8991-67112b4bc62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:25:55.116421 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1355/2720] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:25:54 2022] DELETE /identity/v3/projects/be99030a2b62492283df3a38252855fa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:25:55.121585 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c56b6-b822-4136-b244-5c8aef86e672 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.121854 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c56b6-b822-4136-b244-5c8aef86e672 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.122157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c56b6-b822-4136-b244-5c8aef86e672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.140433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a14c56b6-b822-4136-b244-5c8aef86e672 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:55.141657 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a14c56b6-b822-4136-b244-5c8aef86e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:55.198794 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1366/2721] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:55.207558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3556cc-0113-4ef1-8551-81ea100c1db4 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.207920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3556cc-0113-4ef1-8551-81ea100c1db4 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.215880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3556cc-0113-4ef1-8551-81ea100c1db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.227440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-dd3556cc-0113-4ef1-8551-81ea100c1db4 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:55.228742 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-dd3556cc-0113-4ef1-8551-81ea100c1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:55.237454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1356/2722] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:55.241733 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c56b6-b822-4136-b244-5c8aef86e672 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:55.252244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c56b6-b822-4136-b244-5c8aef86e672 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:55.256909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:55.257592 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.257895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.258219 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.258942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:25:55.259250 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:55.260896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:55.273103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1367/2723] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:25:55.277333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3556cc-0113-4ef1-8551-81ea100c1db4 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:55.286682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3556cc-0113-4ef1-8551-81ea100c1db4 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:55.291594 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab857e-b67d-4139-b20d-e3a9776b4303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:55.292136 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab857e-b67d-4139-b20d-e3a9776b4303 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.292294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab857e-b67d-4139-b20d-e3a9776b4303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.292574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab857e-b67d-4139-b20d-e3a9776b4303 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.293300 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab857e-b67d-4139-b20d-e3a9776b4303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:55.295253 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab857e-b67d-4139-b20d-e3a9776b4303 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:55.396366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1357/2724] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:25:55 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:55.400364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:55.410844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d43da1-bb4a-42fb-aad1-b583168b761d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:55.443522 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:55.467518 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b427c3-89d5-4594-ada7-cff99adec639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:55.468291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b427c3-89d5-4594-ada7-cff99adec639 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.468626 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b427c3-89d5-4594-ada7-cff99adec639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.468912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b427c3-89d5-4594-ada7-cff99adec639 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.469607 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b427c3-89d5-4594-ada7-cff99adec639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:55.471588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b427c3-89d5-4594-ada7-cff99adec639 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:55.566268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1368/2725] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:25:55 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:25:55.570309 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab857e-b67d-4139-b20d-e3a9776b4303 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:55.580418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab857e-b67d-4139-b20d-e3a9776b4303 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:55.585286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf055f7-847d-4cca-aa59-16a1f2021bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:55.585946 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf055f7-847d-4cca-aa59-16a1f2021bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.586550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf055f7-847d-4cca-aa59-16a1f2021bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.586832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf055f7-847d-4cca-aa59-16a1f2021bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.587564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf055f7-847d-4cca-aa59-16a1f2021bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:55.589160 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf055f7-847d-4cca-aa59-16a1f2021bf1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:55.599547 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1358/2726] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:25:55.609120 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b427c3-89d5-4594-ada7-cff99adec639 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:55.618931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b427c3-89d5-4594-ada7-cff99adec639 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:55.624367 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71fb4b-1f71-4ce0-84c9-2342ab79d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:55.625027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71fb4b-1f71-4ce0-84c9-2342ab79d5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.625311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71fb4b-1f71-4ce0-84c9-2342ab79d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.625590 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71fb4b-1f71-4ce0-84c9-2342ab79d5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.626685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71fb4b-1f71-4ce0-84c9-2342ab79d5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:55.627966 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71fb4b-1f71-4ce0-84c9-2342ab79d5ab admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:55.645837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1369/2727] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:25:55.649657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf055f7-847d-4cca-aa59-16a1f2021bf1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:55.660180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf055f7-847d-4cca-aa59-16a1f2021bf1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:55.664882 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:55.665763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.666074 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.666356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] PATH_INFO: `/v3/projects/ea598a99404a49f6b0020923c50c1f65/users/7a3a38e1ee7c43a98c209a2a297076fc/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.681540 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea598a99404a49f6b0020923c50c1f65, user_id=7a3a38e1ee7c43a98c209a2a297076fc, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:55.684241 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:55.783738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1359/2728] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:25:55 2022] PUT /identity/v3/projects/ea598a99404a49f6b0020923c50c1f65/users/7a3a38e1ee7c43a98c209a2a297076fc/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:25:55.794598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682153c-51ea-4776-aa60-3aefb3e6bd5e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.795119 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682153c-51ea-4776-aa60-3aefb3e6bd5e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.795271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682153c-51ea-4776-aa60-3aefb3e6bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.822198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a682153c-51ea-4776-aa60-3aefb3e6bd5e None None] MFA Rules not processed for user `7a3a38e1ee7c43a98c209a2a297076fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:25:55.823420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a682153c-51ea-4776-aa60-3aefb3e6bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:55.888326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1370/2729] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:25:55.900313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:25:55.902299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:25:55.959617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:25:55.963627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2787d-3d4b-43ad-8be9-8093e5f09dcc admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:25:55.967511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0c80-87db-45e9-b419-7afc0e5eef58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca08d82f02a24e0088aceff2b6ba307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:25:55.968163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0c80-87db-45e9-b419-7afc0e5eef58 service glance] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:25:55.968450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0c80-87db-45e9-b419-7afc0e5eef58 service glance] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:25:55.968728 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0c80-87db-45e9-b419-7afc0e5eef58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:25:55.976965 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb0c80-87db-45e9-b419-7afc0e5eef58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:25:55.978441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb0c80-87db-45e9-b419-7afc0e5eef58 service glance] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:25:55.987158 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1360/2730] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:25:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:01.700300 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682153c-51ea-4776-aa60-3aefb3e6bd5e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:01.701706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a682153c-51ea-4776-aa60-3aefb3e6bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:01.768751 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682153c-51ea-4776-aa60-3aefb3e6bd5e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:01.773432 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:01.778217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:01.778217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:01.778217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] PATH_INFO: `/v3/users/ed3721df486f43458a459b5d5f330d92` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:01.778217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3721df486f43458a459b5d5f330d92)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:01.778217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:01.980122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:01.982287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3721df486f43458a459b5d5f330d92'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:01.989112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3721df486f43458a459b5d5f330d92'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.059232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3721df486f43458a459b5d5f330d92'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.059924 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3721df486f43458a459b5d5f330d92'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.060535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3721df486f43458a459b5d5f330d92'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.080581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1371/2731] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:01 2022] DELETE /identity/v3/users/ed3721df486f43458a459b5d5f330d92 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:02.086146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce674e-66ee-4974-b0a1-38e1ba423f83 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:02.086146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce674e-66ee-4974-b0a1-38e1ba423f83 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:02.086146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce674e-66ee-4974-b0a1-38e1ba423f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:02.105142 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-abce674e-66ee-4974-b0a1-38e1ba423f83 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:02.106534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-abce674e-66ee-4974-b0a1-38e1ba423f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:02.190897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1361/2732] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:02.202582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:02.204277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:02.268545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3153f-6fdb-4a0f-bc08-a867853a9808 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:02.272449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:02.273181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:02.273471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:02.273746 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:02.283490 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:02.284933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:02.294311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1372/2733] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:02.765667 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce674e-66ee-4974-b0a1-38e1ba423f83 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:02.767442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-abce674e-66ee-4974-b0a1-38e1ba423f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:02.789042 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce674e-66ee-4974-b0a1-38e1ba423f83 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:02.793893 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:02.794883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:02.795274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:02.795674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] PATH_INFO: `/v3/projects/cc13295ca1b04417b702b1e5163d666b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:02.796963 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc13295ca1b04417b702b1e5163d666b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:02.799049 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:02.902046 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:02.903787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:02.909910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc13295ca1b04417b702b1e5163d666b', 'request_id': 'req-c4fe1cbb-62fc-41a5-8486-54876a95c72e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.916377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc13295ca1b04417b702b1e5163d666b', 'request_id': 'req-c4fe1cbb-62fc-41a5-8486-54876a95c72e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.917547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f1f4-cc28-4cd4-a54e-c305c62defb4 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:02.978456 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc13295ca1b04417b702b1e5163d666b', 'request_id': 'req-c4fe1cbb-62fc-41a5-8486-54876a95c72e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.980634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:02.982069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:02.982363 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:02.982644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] PATH_INFO: `/v3/users/352f95e0470b417981cfb76f162cae61` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:02.983844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=352f95e0470b417981cfb76f162cae61)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:02.985800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:02.996217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] The token cache is being invalidate because project cc13295ca1b04417b702b1e5163d666b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:02.996217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.996217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:02.996217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1362/2734] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:02 2022] DELETE /identity/v3/projects/cc13295ca1b04417b702b1e5163d666b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:02.998166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:02.999826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:03.012460 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe1cbb-62fc-41a5-8486-54876a95c72e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:03.017246 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:03.018146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:03.018439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:03.024817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] PATH_INFO: `/v3/users/41ec4aaa069e49f799ae49cd8fc50951` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:03.024817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ec4aaa069e49f799ae49cd8fc50951)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:03.024817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:03.143741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352f95e0470b417981cfb76f162cae61'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.150506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352f95e0470b417981cfb76f162cae61'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.202928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ec4aaa069e49f799ae49cd8fc50951'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.209829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ec4aaa069e49f799ae49cd8fc50951'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.210536 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ec4aaa069e49f799ae49cd8fc50951'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.211167 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ec4aaa069e49f799ae49cd8fc50951'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.216695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352f95e0470b417981cfb76f162cae61'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.225072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352f95e0470b417981cfb76f162cae61'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.225072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ccb03a01-91a9-4cec-ac08-398b039778bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352f95e0470b417981cfb76f162cae61'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.225072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:03.237553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1373/2735] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:02 2022] DELETE /identity/v3/users/352f95e0470b417981cfb76f162cae61 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:03.241850 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1453-adc9-40dd-93fd-ddf767c79041 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:03.242333 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1453-adc9-40dd-93fd-ddf767c79041 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:03.242691 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1453-adc9-40dd-93fd-ddf767c79041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:03.262417 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c51e1453-adc9-40dd-93fd-ddf767c79041 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:03.263509 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c51e1453-adc9-40dd-93fd-ddf767c79041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:03.291473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ec4aaa069e49f799ae49cd8fc50951'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.297863 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:03.310919 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1363/2736] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:02 2022] DELETE /identity/v3/users/41ec4aaa069e49f799ae49cd8fc50951 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:03.324059 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1374/2737] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:03.333399 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:03.334990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:03.393602 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e46c-e6a5-45fe-9cef-2f2f715b29f5 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:03.397350 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:03.398092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:03.398549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:03.398839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:03.465486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:03.467023 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:03.476585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1364/2738] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:03.775205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1453-adc9-40dd-93fd-ddf767c79041 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:03.775205 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c51e1453-adc9-40dd-93fd-ddf767c79041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:03.783468 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1453-adc9-40dd-93fd-ddf767c79041 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:03.788235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:03.788980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:03.789272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:03.789552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] PATH_INFO: `/v3/projects/a4da5a244ddb4b258ed5bdf6a1341701` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:03.790797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4da5a244ddb4b258ed5bdf6a1341701)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:03.793107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:03.944289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:03.951616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:03.953566 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4da5a244ddb4b258ed5bdf6a1341701', 'request_id': 'req-7853d630-d2ff-40ef-8b6a-2ec44839eb76'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:03.969276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0e7c-7dfa-4b2f-a2ca-4850107277d4 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.027610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.028725 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.029018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.029308 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] PATH_INFO: `/v3/projects/a8aedb0c3c4443eea5c0def35f377597` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.030527 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8aedb0c3c4443eea5c0def35f377597)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.032455 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.131365 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4da5a244ddb4b258ed5bdf6a1341701', 'request_id': 'req-7853d630-d2ff-40ef-8b6a-2ec44839eb76'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.138149 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4da5a244ddb4b258ed5bdf6a1341701', 'request_id': 'req-7853d630-d2ff-40ef-8b6a-2ec44839eb76'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.148552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] The token cache is being invalidate because project a4da5a244ddb4b258ed5bdf6a1341701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:04.148843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.149474 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7853d630-d2ff-40ef-8b6a-2ec44839eb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.151105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1375/2739] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:03 2022] DELETE /identity/v3/projects/a4da5a244ddb4b258ed5bdf6a1341701 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:04.156604 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3468-6dc9-4918-8367-6077f40211cd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.156928 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3468-6dc9-4918-8367-6077f40211cd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.157214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3468-6dc9-4918-8367-6077f40211cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.175601 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b67d3468-6dc9-4918-8367-6077f40211cd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:04.179637 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b67d3468-6dc9-4918-8367-6077f40211cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:04.185221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1376/2740] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:04.193210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385c63-1fba-4d2c-ab58-4346ccc17b91 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.193505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385c63-1fba-4d2c-ab58-4346ccc17b91 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.193793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385c63-1fba-4d2c-ab58-4346ccc17b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.218093 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f7385c63-1fba-4d2c-ab58-4346ccc17b91 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:04.218573 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:04.219990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f7385c63-1fba-4d2c-ab58-4346ccc17b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:04.227876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8aedb0c3c4443eea5c0def35f377597', 'request_id': 'req-14adad57-fa5c-492c-b939-227fec2cea02'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.235504 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8aedb0c3c4443eea5c0def35f377597', 'request_id': 'req-14adad57-fa5c-492c-b939-227fec2cea02'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.277503 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1377/2741] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:04.282727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385c63-1fba-4d2c-ab58-4346ccc17b91 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:04.286798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:04.291663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385c63-1fba-4d2c-ab58-4346ccc17b91 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.296901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.297547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.297831 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.298138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.298865 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:26:04.299173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.300805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.312175 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1378/2742] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:26:04.316705 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:04.326214 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12793bf0-ba01-4e2a-bc0b-90889004809c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.330958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.331597 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.331883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.332172 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.332834 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.334806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.342827 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8aedb0c3c4443eea5c0def35f377597', 'request_id': 'req-14adad57-fa5c-492c-b939-227fec2cea02'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.354177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] The token cache is being invalidate because project a8aedb0c3c4443eea5c0def35f377597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:04.354539 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.355182 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.357309 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1365/2743] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:03 2022] DELETE /identity/v3/projects/a8aedb0c3c4443eea5c0def35f377597 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:04.361284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:04.362610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:04.374885 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adad57-fa5c-492c-b939-227fec2cea02 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.379461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.380310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.380596 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.380873 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] PATH_INFO: `/v3/users/04a7a69e214c481db7b2184bab8a9298` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.382064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a7a69e214c481db7b2184bab8a9298)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.384061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.431581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1379/2744] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:04 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:26:04.436294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:04.438448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:04.507878 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04605c06-2bf6-4762-b7fd-c685a112046a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.513032 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6e0d4-2287-486d-8a60-9773304f9ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.520719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6e0d4-2287-486d-8a60-9773304f9ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.520719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6e0d4-2287-486d-8a60-9773304f9ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.520719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6e0d4-2287-486d-8a60-9773304f9ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.520719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6e0d4-2287-486d-8a60-9773304f9ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.520719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6e0d4-2287-486d-8a60-9773304f9ce3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.605482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1380/2745] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:04 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:26:04.606427 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6e0d4-2287-486d-8a60-9773304f9ce3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:04.609471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a7a69e214c481db7b2184bab8a9298'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.616003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6e0d4-2287-486d-8a60-9773304f9ce3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.616595 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a7a69e214c481db7b2184bab8a9298'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.617310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a7a69e214c481db7b2184bab8a9298'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.617973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a7a69e214c481db7b2184bab8a9298'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.620868 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.621515 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.621797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.622107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.622817 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.624401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.634246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1381/2746] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:04.638596 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:04.640203 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:04.652187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db14e5d-0edf-490e-b131-4c8b14d0941a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.657459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24875359-42f2-463d-b4ad-448bb1f93ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.658117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24875359-42f2-463d-b4ad-448bb1f93ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.658408 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24875359-42f2-463d-b4ad-448bb1f93ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.658687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24875359-42f2-463d-b4ad-448bb1f93ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.659388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24875359-42f2-463d-b4ad-448bb1f93ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.660933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24875359-42f2-463d-b4ad-448bb1f93ffe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.670405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1382/2747] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:04.675271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24875359-42f2-463d-b4ad-448bb1f93ffe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:04.684447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24875359-42f2-463d-b4ad-448bb1f93ffe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.689034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.689853 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.690168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.690448 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] PATH_INFO: `/v3/projects/d82ff87525144dee8176a82f887b1565/users/be792752775c453fb8f3707290580664/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.693131 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-bd0a44d9-0f2f-4897-84b9-d147509a0b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a7a69e214c481db7b2184bab8a9298'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:04.710732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82ff87525144dee8176a82f887b1565, user_id=be792752775c453fb8f3707290580664, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.714138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.715690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1366/2748] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:04 2022] DELETE /identity/v3/users/04a7a69e214c481db7b2184bab8a9298 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:04.779517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1383/2749] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:04 2022] PUT /identity/v3/projects/d82ff87525144dee8176a82f887b1565/users/be792752775c453fb8f3707290580664/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:04.789874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10415-fe4e-49a8-b127-6f24545b01f5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.790306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10415-fe4e-49a8-b127-6f24545b01f5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.790591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10415-fe4e-49a8-b127-6f24545b01f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.816941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-cef10415-fe4e-49a8-b127-6f24545b01f5 None None] MFA Rules not processed for user `be792752775c453fb8f3707290580664`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:04.818283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-cef10415-fe4e-49a8-b127-6f24545b01f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:04.882366 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1367/2750] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:04.894081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:04.895848 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:04.967014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f73fd-8b42-4e28-933b-cddc4e3a41c4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:04.971495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:04.972274 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:04.972631 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:04.972978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:04.985103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:04.986632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:04.996430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1384/2751] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:05.016914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef10415-fe4e-49a8-b127-6f24545b01f5 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:05.047918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:05.079347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef10415-fe4e-49a8-b127-6f24545b01f5 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:05.083913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:05.084788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.085078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.085358 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] PATH_INFO: `/v3/users/be792752775c453fb8f3707290580664` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.086563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be792752775c453fb8f3707290580664)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:05.088502 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:05.111260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:05.112895 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:05.128045 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbba5c5-a85e-46d8-8f1c-6c3b8eefdb5d service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:05.132785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:05.133655 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.133941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.134260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] PATH_INFO: `/v3/projects/595f385393b74f02a63f34539a7c5c44` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.135510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=595f385393b74f02a63f34539a7c5c44)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:05.137425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:05.146630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:05.294400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be792752775c453fb8f3707290580664'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.294968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595f385393b74f02a63f34539a7c5c44', 'request_id': 'req-cb0fbc39-6694-46d1-ad9d-91152ec39130'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.301621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be792752775c453fb8f3707290580664'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.302320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be792752775c453fb8f3707290580664'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.302922 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be792752775c453fb8f3707290580664'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.394166 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595f385393b74f02a63f34539a7c5c44', 'request_id': 'req-cb0fbc39-6694-46d1-ad9d-91152ec39130'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.400980 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595f385393b74f02a63f34539a7c5c44', 'request_id': 'req-cb0fbc39-6694-46d1-ad9d-91152ec39130'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.412151 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] The token cache is being invalidate because project 595f385393b74f02a63f34539a7c5c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:05.412438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.413075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb0fbc39-6694-46d1-ad9d-91152ec39130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.414761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1385/2752] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:05 2022] DELETE /identity/v3/projects/595f385393b74f02a63f34539a7c5c44 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:05.420047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de8616-69c5-43ba-8ce9-b388194305dc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.420338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de8616-69c5-43ba-8ce9-b388194305dc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.420621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de8616-69c5-43ba-8ce9-b388194305dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.438430 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-16de8616-69c5-43ba-8ce9-b388194305dc None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:05.439621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-16de8616-69c5-43ba-8ce9-b388194305dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:05.446990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a2a6aed0-b890-41c0-bc6b-35b19b0ba39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be792752775c453fb8f3707290580664'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:05.467936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1368/2753] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:05 2022] DELETE /identity/v3/users/be792752775c453fb8f3707290580664 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:05.473390 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b16ec5-b4fc-448c-b038-a0d7543d37e7 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.473707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b16ec5-b4fc-448c-b038-a0d7543d37e7 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.474006 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b16ec5-b4fc-448c-b038-a0d7543d37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.492293 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-19b16ec5-b4fc-448c-b038-a0d7543d37e7 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:05.493637 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-19b16ec5-b4fc-448c-b038-a0d7543d37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:05.509077 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1386/2754] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:05.517906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4609-8ac3-4bbd-956c-8cbd500ed9fd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.518239 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4609-8ac3-4bbd-956c-8cbd500ed9fd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.518525 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4609-8ac3-4bbd-956c-8cbd500ed9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.536246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e1cc4609-8ac3-4bbd-956c-8cbd500ed9fd None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:05.537433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e1cc4609-8ac3-4bbd-956c-8cbd500ed9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:05.555389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1369/2755] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:05.565638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b16ec5-b4fc-448c-b038-a0d7543d37e7 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:05.567238 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-19b16ec5-b4fc-448c-b038-a0d7543d37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:05.598116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1387/2756] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:05.599878 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4609-8ac3-4bbd-956c-8cbd500ed9fd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:05.608976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4609-8ac3-4bbd-956c-8cbd500ed9fd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:05.613576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:05.614254 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.614541 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.614815 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.615535 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:26:05.615840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:05.617433 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:05.622525 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:05.626699 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b16ec5-b4fc-448c-b038-a0d7543d37e7 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:05.629347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1388/2757] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:26:05.631090 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d440b1-b318-487c-9c7c-b490f3cd2c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:05.633747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d440b1-b318-487c-9c7c-b490f3cd2c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.633747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d440b1-b318-487c-9c7c-b490f3cd2c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.633747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d440b1-b318-487c-9c7c-b490f3cd2c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.634050 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:05.642517 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d440b1-b318-487c-9c7c-b490f3cd2c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:05.644132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2fae-7958-4dd3-b5f1-a5cf349c113b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:05.644585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d440b1-b318-487c-9c7c-b490f3cd2c2a service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:05.648783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac93ca-5a0d-4b1c-98b4-289b89604786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:05.649415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac93ca-5a0d-4b1c-98b4-289b89604786 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.649700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac93ca-5a0d-4b1c-98b4-289b89604786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.650004 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac93ca-5a0d-4b1c-98b4-289b89604786 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.650671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac93ca-5a0d-4b1c-98b4-289b89604786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:05.652550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac93ca-5a0d-4b1c-98b4-289b89604786 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:05.654650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1370/2758] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:26:05.774639 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1389/2759] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:05 2022] POST /identity/v3/projects => generated 353 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:26:05.779046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d440b1-b318-487c-9c7c-b490f3cd2c2a service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:05.788740 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d440b1-b318-487c-9c7c-b490f3cd2c2a service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:05.847098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dd49-162d-40e1-bc25-6425bfcd6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:05.847842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dd49-162d-40e1-bc25-6425bfcd6da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.848137 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dd49-162d-40e1-bc25-6425bfcd6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.848418 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dd49-162d-40e1-bc25-6425bfcd6da8 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.849128 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07dd49-162d-40e1-bc25-6425bfcd6da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:05.851122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07dd49-162d-40e1-bc25-6425bfcd6da8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:05.933835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1371/2760] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:05 2022] POST /identity/v3/users => generated 277 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:05.938060 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac93ca-5a0d-4b1c-98b4-289b89604786 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:05.943469 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:05.948995 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac93ca-5a0d-4b1c-98b4-289b89604786 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:05.954390 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9dac8-c532-4648-bdad-6ecbf2486783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:05.955110 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9dac8-c532-4648-bdad-6ecbf2486783 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.955412 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9dac8-c532-4648-bdad-6ecbf2486783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.955687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9dac8-c532-4648-bdad-6ecbf2486783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:05.956439 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9dac8-c532-4648-bdad-6ecbf2486783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:05.958202 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9dac8-c532-4648-bdad-6ecbf2486783 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:05.970521 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1390/2761] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:05.974793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dd49-162d-40e1-bc25-6425bfcd6da8 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:05.991466 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dd49-162d-40e1-bc25-6425bfcd6da8 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:05.998194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:05.998955 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:05.999235 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:05.999509 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.000271 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.001900 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.012323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1372/2762] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:06.016664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9dac8-c532-4648-bdad-6ecbf2486783 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.026500 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9dac8-c532-4648-bdad-6ecbf2486783 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.031396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3dda7-154f-474d-851f-7d01fbb22222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.032271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3dda7-154f-474d-851f-7d01fbb22222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.032554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3dda7-154f-474d-851f-7d01fbb22222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.032828 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3dda7-154f-474d-851f-7d01fbb22222 admin admin] PATH_INFO: `/v3/projects/b2f88f465cae46c593f3339b7bef3614/users/defe4a4b0b644b1eb9ec57f1b3a364ab/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.047824 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3dda7-154f-474d-851f-7d01fbb22222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f88f465cae46c593f3339b7bef3614, user_id=defe4a4b0b644b1eb9ec57f1b3a364ab, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.050552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3dda7-154f-474d-851f-7d01fbb22222 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.076101 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.077845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:06.091370 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b14d2-8924-4a46-b5c6-0c9ed3fee3ad admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.097172 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.101269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.101269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.101269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] PATH_INFO: `/v3/projects/d82ff87525144dee8176a82f887b1565` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.101269 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82ff87525144dee8176a82f887b1565)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.102587 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.150782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1391/2763] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:06 2022] PUT /identity/v3/projects/b2f88f465cae46c593f3339b7bef3614/users/defe4a4b0b644b1eb9ec57f1b3a364ab/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:06.160941 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482944eb-0df2-4ff5-8fd6-f2d09406b3af None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.161235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482944eb-0df2-4ff5-8fd6-f2d09406b3af None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.161517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482944eb-0df2-4ff5-8fd6-f2d09406b3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.187787 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-482944eb-0df2-4ff5-8fd6-f2d09406b3af None None] MFA Rules not processed for user `defe4a4b0b644b1eb9ec57f1b3a364ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:06.189021 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-482944eb-0df2-4ff5-8fd6-f2d09406b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:06.256756 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82ff87525144dee8176a82f887b1565', 'request_id': 'req-0e2439da-feea-425a-a6bd-31c9ea0ef656'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:06.260720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1392/2764] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:06.263534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82ff87525144dee8176a82f887b1565', 'request_id': 'req-0e2439da-feea-425a-a6bd-31c9ea0ef656'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:06.265337 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482944eb-0df2-4ff5-8fd6-f2d09406b3af None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.326029 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482944eb-0df2-4ff5-8fd6-f2d09406b3af None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.338892 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82ff87525144dee8176a82f887b1565', 'request_id': 'req-0e2439da-feea-425a-a6bd-31c9ea0ef656'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:06.351057 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] The token cache is being invalidate because project d82ff87525144dee8176a82f887b1565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:06.351355 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:06.352036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-0e2439da-feea-425a-a6bd-31c9ea0ef656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:06.353727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1373/2765] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:06 2022] DELETE /identity/v3/projects/d82ff87525144dee8176a82f887b1565 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:06.360323 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2469-f47e-42e1-8ebd-d30e9bc6ee80 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.360614 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2469-f47e-42e1-8ebd-d30e9bc6ee80 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.361039 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2469-f47e-42e1-8ebd-d30e9bc6ee80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.378797 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-350a2469-f47e-42e1-8ebd-d30e9bc6ee80 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:06.380118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-350a2469-f47e-42e1-8ebd-d30e9bc6ee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:06.387944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b72cf-6a3b-4059-b80d-f6de77b09e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.388808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b72cf-6a3b-4059-b80d-f6de77b09e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.389106 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b72cf-6a3b-4059-b80d-f6de77b09e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.389571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b72cf-6a3b-4059-b80d-f6de77b09e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.390311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b72cf-6a3b-4059-b80d-f6de77b09e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.393760 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b72cf-6a3b-4059-b80d-f6de77b09e05 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.432416 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:06.444463 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1374/2766] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:06.451833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b7a04-cba0-43b0-93f6-55adf73b7d36 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.452126 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b7a04-cba0-43b0-93f6-55adf73b7d36 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.452407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b7a04-cba0-43b0-93f6-55adf73b7d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.470804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-582b7a04-cba0-43b0-93f6-55adf73b7d36 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:06.472433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-582b7a04-cba0-43b0-93f6-55adf73b7d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:06.487932 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1393/2767] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:06 2022] POST /identity/v3/projects => generated 355 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:06.488163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1375/2768] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:06.489241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b72cf-6a3b-4059-b80d-f6de77b09e05 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.489590 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b7a04-cba0-43b0-93f6-55adf73b7d36 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.491263 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-582b7a04-cba0-43b0-93f6-55adf73b7d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:06.504447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b7a04-cba0-43b0-93f6-55adf73b7d36 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.519098 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:06.555124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b72cf-6a3b-4059-b80d-f6de77b09e05 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.559813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.560471 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.560864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.561138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.561859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:26:06.562002 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67787b-13e7-4bde-8bce-1122d44ee7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.562192 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.562652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67787b-13e7-4bde-8bce-1122d44ee7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.562940 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67787b-13e7-4bde-8bce-1122d44ee7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.563221 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67787b-13e7-4bde-8bce-1122d44ee7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.563793 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.563906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67787b-13e7-4bde-8bce-1122d44ee7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.565978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67787b-13e7-4bde-8bce-1122d44ee7d2 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.579221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1394/2769] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:26:06.580191 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.589451 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984812b-5014-4184-8ea1-7bfd638e07fc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.594493 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4db78f-d05c-447d-8e10-648b80ac0421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.595105 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4db78f-d05c-447d-8e10-648b80ac0421 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.595387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4db78f-d05c-447d-8e10-648b80ac0421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.595663 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4db78f-d05c-447d-8e10-648b80ac0421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.596331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4db78f-d05c-447d-8e10-648b80ac0421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.598280 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4db78f-d05c-447d-8e10-648b80ac0421 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.645565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1376/2770] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:06 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:06.649320 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67787b-13e7-4bde-8bce-1122d44ee7d2 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.659451 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67787b-13e7-4bde-8bce-1122d44ee7d2 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.664036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a5877-8bbd-4659-afd3-34cc7d2640c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.664670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a5877-8bbd-4659-afd3-34cc7d2640c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.664959 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a5877-8bbd-4659-afd3-34cc7d2640c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.665242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a5877-8bbd-4659-afd3-34cc7d2640c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.665981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a5877-8bbd-4659-afd3-34cc7d2640c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.667574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a5877-8bbd-4659-afd3-34cc7d2640c7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.677809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1377/2771] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:06.681514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a5877-8bbd-4659-afd3-34cc7d2640c7 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.690729 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a5877-8bbd-4659-afd3-34cc7d2640c7 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.696224 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339f22e-4f52-4a1c-8f67-aabaf0328d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.697059 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339f22e-4f52-4a1c-8f67-aabaf0328d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.697347 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339f22e-4f52-4a1c-8f67-aabaf0328d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.697622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339f22e-4f52-4a1c-8f67-aabaf0328d46 admin admin] PATH_INFO: `/v3/projects/6cdb066a28f0487dad6f0a9a2c12a907/users/cd55624e83e1427096fcbd3e6930ff2b/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.705447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1395/2772] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:06 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:26:06.709425 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4db78f-d05c-447d-8e10-648b80ac0421 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.713291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339f22e-4f52-4a1c-8f67-aabaf0328d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdb066a28f0487dad6f0a9a2c12a907, user_id=cd55624e83e1427096fcbd3e6930ff2b, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.717391 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339f22e-4f52-4a1c-8f67-aabaf0328d46 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.779589 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1378/2773] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:06 2022] PUT /identity/v3/projects/6cdb066a28f0487dad6f0a9a2c12a907/users/cd55624e83e1427096fcbd3e6930ff2b/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:06.784250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339f22e-4f52-4a1c-8f67-aabaf0328d46 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.790814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4db78f-d05c-447d-8e10-648b80ac0421 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.847883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339f22e-4f52-4a1c-8f67-aabaf0328d46 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.849782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fce19e-5a7e-480a-ac50-16dd64594a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.850487 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fce19e-5a7e-480a-ac50-16dd64594a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.850767 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fce19e-5a7e-480a-ac50-16dd64594a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.851039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fce19e-5a7e-480a-ac50-16dd64594a29 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.851718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fce19e-5a7e-480a-ac50-16dd64594a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.852544 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36649b2-10fb-44e0-9142-8470a47b4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.853229 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36649b2-10fb-44e0-9142-8470a47b4848 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.853543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36649b2-10fb-44e0-9142-8470a47b4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.853647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fce19e-5a7e-480a-ac50-16dd64594a29 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.853822 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36649b2-10fb-44e0-9142-8470a47b4848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.854607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36649b2-10fb-44e0-9142-8470a47b4848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.856255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36649b2-10fb-44e0-9142-8470a47b4848 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.866338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1379/2774] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:06.870617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36649b2-10fb-44e0-9142-8470a47b4848 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.880098 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36649b2-10fb-44e0-9142-8470a47b4848 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.884745 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de8db3-68c5-42ca-acf2-fffa46f93285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:06.885588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de8db3-68c5-42ca-acf2-fffa46f93285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.885906 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de8db3-68c5-42ca-acf2-fffa46f93285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.886215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de8db3-68c5-42ca-acf2-fffa46f93285 admin admin] PATH_INFO: `/v3/projects/6cdb066a28f0487dad6f0a9a2c12a907/users/cd55624e83e1427096fcbd3e6930ff2b/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.888646 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de8db3-68c5-42ca-acf2-fffa46f93285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdb066a28f0487dad6f0a9a2c12a907, user_id=cd55624e83e1427096fcbd3e6930ff2b, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:06.891322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de8db3-68c5-42ca-acf2-fffa46f93285 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:06.901206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1380/2775] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:06 2022] PUT /identity/v3/projects/6cdb066a28f0487dad6f0a9a2c12a907/users/cd55624e83e1427096fcbd3e6930ff2b/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:06.911560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca989-1af1-4387-bb19-b5078945322d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:06.911806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca989-1af1-4387-bb19-b5078945322d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:06.912088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca989-1af1-4387-bb19-b5078945322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:06.921752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:06.928841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1396/2776] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:06 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:26:06.932958 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fce19e-5a7e-480a-ac50-16dd64594a29 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:06.939697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-608ca989-1af1-4387-bb19-b5078945322d None None] MFA Rules not processed for user `cd55624e83e1427096fcbd3e6930ff2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:06.940916 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-608ca989-1af1-4387-bb19-b5078945322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:06.942359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fce19e-5a7e-480a-ac50-16dd64594a29 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:06.953027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:07.000182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2958d-e8f5-46f9-8381-a0f93ff11d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:07.001704 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2958d-e8f5-46f9-8381-a0f93ff11d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:07.002277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2958d-e8f5-46f9-8381-a0f93ff11d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:07.002720 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2958d-e8f5-46f9-8381-a0f93ff11d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:07.003763 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2958d-e8f5-46f9-8381-a0f93ff11d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:07.005738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2958d-e8f5-46f9-8381-a0f93ff11d24 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:07.019402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1397/2777] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:07.022302 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1381/2778] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:07.023311 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2958d-e8f5-46f9-8381-a0f93ff11d24 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:07.033678 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2958d-e8f5-46f9-8381-a0f93ff11d24 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:07.034231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca989-1af1-4387-bb19-b5078945322d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:07.036076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-608ca989-1af1-4387-bb19-b5078945322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:07.038410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0a889-b0ef-4937-bb72-af9fe30ce009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:07.039068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0a889-b0ef-4937-bb72-af9fe30ce009 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:07.041414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0a889-b0ef-4937-bb72-af9fe30ce009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:07.041414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0a889-b0ef-4937-bb72-af9fe30ce009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:07.041414 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0a889-b0ef-4937-bb72-af9fe30ce009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:07.041939 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0a889-b0ef-4937-bb72-af9fe30ce009 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:07.051829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1398/2779] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:07.056117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0a889-b0ef-4937-bb72-af9fe30ce009 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:07.065544 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0a889-b0ef-4937-bb72-af9fe30ce009 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:07.070163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f22af-8a56-406e-b5af-ea55aaf91262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:07.071020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f22af-8a56-406e-b5af-ea55aaf91262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:07.071303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f22af-8a56-406e-b5af-ea55aaf91262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:07.071579 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f22af-8a56-406e-b5af-ea55aaf91262 admin admin] PATH_INFO: `/v3/projects/501ceebb9dc54be6a7a979f426938f2e/users/9f3b1904c2d942338ec439a6950b0061/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:07.087533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f22af-8a56-406e-b5af-ea55aaf91262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501ceebb9dc54be6a7a979f426938f2e, user_id=9f3b1904c2d942338ec439a6950b0061, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:07.090246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f22af-8a56-406e-b5af-ea55aaf91262 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:07.093874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca989-1af1-4387-bb19-b5078945322d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:07.097761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfae30-3f58-4432-9ab5-cab1835dc1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:07.098479 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfae30-3f58-4432-9ab5-cab1835dc1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:07.098769 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfae30-3f58-4432-9ab5-cab1835dc1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:07.099053 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfae30-3f58-4432-9ab5-cab1835dc1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:07.108805 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfae30-3f58-4432-9ab5-cab1835dc1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:07.110283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfae30-3f58-4432-9ab5-cab1835dc1d0 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:07.119845 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1382/2780] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:26:07.173450 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1399/2781] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:07 2022] PUT /identity/v3/projects/501ceebb9dc54be6a7a979f426938f2e/users/9f3b1904c2d942338ec439a6950b0061/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:07.183880 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38dcc-83bd-4bce-b2c2-0e18f8d45d18 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:07.184181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38dcc-83bd-4bce-b2c2-0e18f8d45d18 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:07.185025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca38dcc-83bd-4bce-b2c2-0e18f8d45d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:07.215243 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-3ca38dcc-83bd-4bce-b2c2-0e18f8d45d18 None None] MFA Rules not processed for user `9f3b1904c2d942338ec439a6950b0061`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:07.216510 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3ca38dcc-83bd-4bce-b2c2-0e18f8d45d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:07.286226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1383/2782] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:07.296874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f22af-8a56-406e-b5af-ea55aaf91262 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:07.323148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38dcc-83bd-4bce-b2c2-0e18f8d45d18 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:07.324617 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-3ca38dcc-83bd-4bce-b2c2-0e18f8d45d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:07.356821 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f22af-8a56-406e-b5af-ea55aaf91262 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:07.360681 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c080403-0cd7-4e74-841d-077cf2b2bf0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:07.361332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c080403-0cd7-4e74-841d-077cf2b2bf0c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:07.361620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c080403-0cd7-4e74-841d-077cf2b2bf0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:07.361898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c080403-0cd7-4e74-841d-077cf2b2bf0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:07.370902 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c080403-0cd7-4e74-841d-077cf2b2bf0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:07.371043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:07.372896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c080403-0cd7-4e74-841d-077cf2b2bf0c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:07.382173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1400/2783] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:07.391119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca38dcc-83bd-4bce-b2c2-0e18f8d45d18 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:07.391119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:07.391119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:07.391119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:07.391788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:07.391788 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:07.448236 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:07.449599 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:07.459376 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1384/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:26:17.377843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:17.455467 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=29 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:17.649738 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c080403-0cd7-4e74-841d-077cf2b2bf0c service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:17.718388 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c080403-0cd7-4e74-841d-077cf2b2bf0c service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:17.723744 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:17.724700 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:17.779284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:17.779284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] PATH_INFO: `/v3/users/9f3b1904c2d942338ec439a6950b0061` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:17.779284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3b1904c2d942338ec439a6950b0061)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:17.779284 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:18.093062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:18.095119 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:18.169904 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3b1904c2d942338ec439a6950b0061'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:18.177558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8954c55-f67d-473b-abcc-f9e5ab004442 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:18.178956 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3b1904c2d942338ec439a6950b0061'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:18.181468 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd01471-0597-4d6f-a196-8e3effe0dc8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:18.182185 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01471-0597-4d6f-a196-8e3effe0dc8b service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:18.182471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01471-0597-4d6f-a196-8e3effe0dc8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:18.182753 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd01471-0597-4d6f-a196-8e3effe0dc8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:18.184923 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-7cd01471-0597-4d6f-a196-8e3effe0dc8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:18.195180 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd01471-0597-4d6f-a196-8e3effe0dc8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:18.197274 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd01471-0597-4d6f-a196-8e3effe0dc8b service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:18.206618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1385/2785] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:18.264341 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3b1904c2d942338ec439a6950b0061'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:18.265418 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3b1904c2d942338ec439a6950b0061'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:18.265690 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3b1904c2d942338ec439a6950b0061'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:18.289698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1401/2786] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:17 2022] DELETE /identity/v3/users/9f3b1904c2d942338ec439a6950b0061 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:18.299678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b964cb-6a3a-4e12-add5-1f19e318f923 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:18.300044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b964cb-6a3a-4e12-add5-1f19e318f923 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:18.300400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b964cb-6a3a-4e12-add5-1f19e318f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:18.325595 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-d6b964cb-6a3a-4e12-add5-1f19e318f923 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:18.327145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d6b964cb-6a3a-4e12-add5-1f19e318f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:18.396529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1386/2787] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:18.407230 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:18.411318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:18.474466 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519f89c-22c2-448f-8d0b-1a6356dfaed2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:18.478144 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22b1b8-fe44-41e2-852f-b63c4e8b03ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:18.478809 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22b1b8-fe44-41e2-852f-b63c4e8b03ec service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:18.479092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22b1b8-fe44-41e2-852f-b63c4e8b03ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:18.479423 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22b1b8-fe44-41e2-852f-b63c4e8b03ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:18.489653 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22b1b8-fe44-41e2-852f-b63c4e8b03ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:18.491210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22b1b8-fe44-41e2-852f-b63c4e8b03ec service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:18.505527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1402/2788] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:26:19.135422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b964cb-6a3a-4e12-add5-1f19e318f923 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:19.136998 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d6b964cb-6a3a-4e12-add5-1f19e318f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:19.150593 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b964cb-6a3a-4e12-add5-1f19e318f923 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:19.156373 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:19.157250 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.157591 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.157876 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] PATH_INFO: `/v3/projects/501ceebb9dc54be6a7a979f426938f2e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.159116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=501ceebb9dc54be6a7a979f426938f2e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:19.162203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:19.287382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501ceebb9dc54be6a7a979f426938f2e', 'request_id': 'req-37bae02d-a74a-4666-b8fa-c620da699adf'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:19.293674 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501ceebb9dc54be6a7a979f426938f2e', 'request_id': 'req-37bae02d-a74a-4666-b8fa-c620da699adf'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:19.373471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501ceebb9dc54be6a7a979f426938f2e', 'request_id': 'req-37bae02d-a74a-4666-b8fa-c620da699adf'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:19.384678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] The token cache is being invalidate because project 501ceebb9dc54be6a7a979f426938f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:19.384883 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:19.385526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-37bae02d-a74a-4666-b8fa-c620da699adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:19.388257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1387/2789] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:19 2022] DELETE /identity/v3/projects/501ceebb9dc54be6a7a979f426938f2e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:19.393090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f631d-a544-495a-8987-019c8217dc2d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.393461 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f631d-a544-495a-8987-019c8217dc2d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.393814 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f631d-a544-495a-8987-019c8217dc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.415938 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ff4f631d-a544-495a-8987-019c8217dc2d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:19.417406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ff4f631d-a544-495a-8987-019c8217dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:19.436216 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:19.496316 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1403/2790] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:19.498231 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154bbb-1bdf-46c6-8e99-c5150e1080be None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.498516 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154bbb-1bdf-46c6-8e99-c5150e1080be None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.498794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32154bbb-1bdf-46c6-8e99-c5150e1080be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.518632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-32154bbb-1bdf-46c6-8e99-c5150e1080be None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:19.519847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-32154bbb-1bdf-46c6-8e99-c5150e1080be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:19.527829 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1388/2791] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:19.532374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f631d-a544-495a-8987-019c8217dc2d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:19.541912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f631d-a544-495a-8987-019c8217dc2d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:19.547163 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:19.549015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.549015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.549015 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.549303 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:26:19.549402 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:19.551018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:19.562882 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1404/2792] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:26:19.567181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154bbb-1bdf-46c6-8e99-c5150e1080be None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:19.578297 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32154bbb-1bdf-46c6-8e99-c5150e1080be None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:19.583258 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ed58-23a0-417f-a4e1-ef428efde823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:19.583910 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ed58-23a0-417f-a4e1-ef428efde823 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.584195 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ed58-23a0-417f-a4e1-ef428efde823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.584473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ed58-23a0-417f-a4e1-ef428efde823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.585169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488ed58-23a0-417f-a4e1-ef428efde823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:19.587291 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488ed58-23a0-417f-a4e1-ef428efde823 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:19.675973 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:19.683070 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1389/2793] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:19 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:19.687869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:19.697645 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7685773-e7c5-47ea-a0e8-104ca9e59c85 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:19.755887 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b6d1b-35eb-4e10-a9b7-dc8c9453ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:19.756555 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b6d1b-35eb-4e10-a9b7-dc8c9453ec40 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.756867 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b6d1b-35eb-4e10-a9b7-dc8c9453ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.757139 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b6d1b-35eb-4e10-a9b7-dc8c9453ec40 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.757916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b6d1b-35eb-4e10-a9b7-dc8c9453ec40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:19.759916 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b6d1b-35eb-4e10-a9b7-dc8c9453ec40 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:19.852547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1405/2794] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:19 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:19.857285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ed58-23a0-417f-a4e1-ef428efde823 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:19.867597 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ed58-23a0-417f-a4e1-ef428efde823 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:19.872245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda0748-e39d-40b3-b006-2eda0cd3dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:19.872904 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda0748-e39d-40b3-b006-2eda0cd3dbbb admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.873194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda0748-e39d-40b3-b006-2eda0cd3dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.873474 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda0748-e39d-40b3-b006-2eda0cd3dbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.874228 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda0748-e39d-40b3-b006-2eda0cd3dbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:19.875828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda0748-e39d-40b3-b006-2eda0cd3dbbb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:19.889048 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1390/2795] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:19.891132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b6d1b-35eb-4e10-a9b7-dc8c9453ec40 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:19.901644 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b6d1b-35eb-4e10-a9b7-dc8c9453ec40 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:19.907618 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a908-b07c-4e1d-973f-3a2c0985face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:19.908347 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a908-b07c-4e1d-973f-3a2c0985face admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.908584 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a908-b07c-4e1d-973f-3a2c0985face admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.909014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a908-b07c-4e1d-973f-3a2c0985face admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.909764 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9a908-b07c-4e1d-973f-3a2c0985face admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:19.911403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9a908-b07c-4e1d-973f-3a2c0985face admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:19.922510 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1406/2796] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:19.927775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda0748-e39d-40b3-b006-2eda0cd3dbbb admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:19.937890 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda0748-e39d-40b3-b006-2eda0cd3dbbb admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:19.942687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:19.943635 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:19.943921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:19.944285 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] PATH_INFO: `/v3/projects/895cac3acf584dc1ab220d5f9d91a471/users/bd30f6286c314980901ed496d4ada983/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:19.960422 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895cac3acf584dc1ab220d5f9d91a471, user_id=bd30f6286c314980901ed496d4ada983, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:19.963317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:20.037578 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1391/2797] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:19 2022] PUT /identity/v3/projects/895cac3acf584dc1ab220d5f9d91a471/users/bd30f6286c314980901ed496d4ada983/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:20.104211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384654f5-8f96-4f00-88a7-a401b420470b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:20.104499 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384654f5-8f96-4f00-88a7-a401b420470b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:20.104777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384654f5-8f96-4f00-88a7-a401b420470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:20.132174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-384654f5-8f96-4f00-88a7-a401b420470b None None] MFA Rules not processed for user `bd30f6286c314980901ed496d4ada983`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:20.133385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-384654f5-8f96-4f00-88a7-a401b420470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:20.207800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1407/2798] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:20.219886 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:20.221618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:20.289618 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6755f3e-0237-4b3a-8ae4-c28c529e95a8 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:20.293333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0543-2f28-4a9e-8cd6-50ebe73407c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:20.294016 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0543-2f28-4a9e-8cd6-50ebe73407c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:20.294306 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0543-2f28-4a9e-8cd6-50ebe73407c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:20.294584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0543-2f28-4a9e-8cd6-50ebe73407c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:20.303088 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0543-2f28-4a9e-8cd6-50ebe73407c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:20.304534 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0543-2f28-4a9e-8cd6-50ebe73407c5 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:20.313930 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1392/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:27.469485 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384654f5-8f96-4f00-88a7-a401b420470b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:27.470052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-384654f5-8f96-4f00-88a7-a401b420470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:27.490844 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:27.535829 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384654f5-8f96-4f00-88a7-a401b420470b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:27.540446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:27.543603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:27.543603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:27.543603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] PATH_INFO: `/v3/users/7a3a38e1ee7c43a98c209a2a297076fc` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:27.543603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3a38e1ee7c43a98c209a2a297076fc)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:27.545562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:27.712942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3a38e1ee7c43a98c209a2a297076fc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:27.720877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3a38e1ee7c43a98c209a2a297076fc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:27.766816 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3a38e1ee7c43a98c209a2a297076fc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:27.767446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3a38e1ee7c43a98c209a2a297076fc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:27.768058 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3a38e1ee7c43a98c209a2a297076fc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:27.786625 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1408/2800] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:27 2022] DELETE /identity/v3/users/7a3a38e1ee7c43a98c209a2a297076fc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:27.790836 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dd32-ef26-426c-af10-23bdfaff7ada None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:27.791321 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dd32-ef26-426c-af10-23bdfaff7ada None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:27.791441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01dd32-ef26-426c-af10-23bdfaff7ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:27.808286 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4b01dd32-ef26-426c-af10-23bdfaff7ada None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:27.810071 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4b01dd32-ef26-426c-af10-23bdfaff7ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:28.003675 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1393/2801] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:28.013908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:28.015416 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:28.072802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f870f9-b809-47e6-b2c7-498132f863c1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:28.078871 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:28.079527 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:28.079812 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:28.080090 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:28.089777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:28.091830 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:28.102676 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1409/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:28.522736 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01dd32-ef26-426c-af10-23bdfaff7ada None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:28.525751 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4b01dd32-ef26-426c-af10-23bdfaff7ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:28.537043 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01dd32-ef26-426c-af10-23bdfaff7ada None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:28.541671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:28.542824 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:28.543818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:28.544139 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] PATH_INFO: `/v3/projects/ea598a99404a49f6b0020923c50c1f65` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:28.545905 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea598a99404a49f6b0020923c50c1f65)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:28.550273 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:28.660473 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea598a99404a49f6b0020923c50c1f65', 'request_id': 'req-739f55db-7943-4610-b786-04bc3ac6c077'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:28.666671 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea598a99404a49f6b0020923c50c1f65', 'request_id': 'req-739f55db-7943-4610-b786-04bc3ac6c077'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:28.776017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:28.778240 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:28.784334 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea598a99404a49f6b0020923c50c1f65', 'request_id': 'req-739f55db-7943-4610-b786-04bc3ac6c077'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:28.786433 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:28.799194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] The token cache is being invalidate because project ea598a99404a49f6b0020923c50c1f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:28.799707 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:28.800202 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-739f55db-7943-4610-b786-04bc3ac6c077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:28.801768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1394/2803] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:28 2022] DELETE /identity/v3/projects/ea598a99404a49f6b0020923c50c1f65 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:28.805571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d230200-78c5-4b73-8720-3a4bb2322b80 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:28.807261 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd90c28-e226-4eb6-a553-f62f5edae71d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:28.808069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd90c28-e226-4eb6-a553-f62f5edae71d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:28.808647 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd90c28-e226-4eb6-a553-f62f5edae71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:28.832833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-5cd90c28-e226-4eb6-a553-f62f5edae71d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:28.834550 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-5cd90c28-e226-4eb6-a553-f62f5edae71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:28.863199 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:28.891512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:28.892549 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:28.892841 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:28.893124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] PATH_INFO: `/v3/users/defe4a4b0b644b1eb9ec57f1b3a364ab` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:28.894571 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=defe4a4b0b644b1eb9ec57f1b3a364ab)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:28.897301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:28.924194 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1395/2804] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:28.931520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2a3b1-85fb-4d8f-ac44-cbfe95a27d51 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:28.931835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2a3b1-85fb-4d8f-ac44-cbfe95a27d51 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:28.932113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2a3b1-85fb-4d8f-ac44-cbfe95a27d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:28.950440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-96e2a3b1-85fb-4d8f-ac44-cbfe95a27d51 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:28.951627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-96e2a3b1-85fb-4d8f-ac44-cbfe95a27d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:28.959429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1396/2805] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:28.963384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2a3b1-85fb-4d8f-ac44-cbfe95a27d51 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:28.973092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2a3b1-85fb-4d8f-ac44-cbfe95a27d51 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:28.978120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:28.978773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:28.980257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:28.980257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:28.980257 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:26:28.980698 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:28.982214 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:28.993782 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1397/2806] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:26:28.997991 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:29.007374 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec88d3-d2f3-49df-8bce-aa3c2914ff2e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:29.012779 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe5755-78c4-4ece-b3fc-e4e08140a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:29.013446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5755-78c4-4ece-b3fc-e4e08140a8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.013730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5755-78c4-4ece-b3fc-e4e08140a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.014022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5755-78c4-4ece-b3fc-e4e08140a8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.014713 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe5755-78c4-4ece-b3fc-e4e08140a8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:29.016629 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe5755-78c4-4ece-b3fc-e4e08140a8b0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:29.128554 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1398/2807] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:28 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:29.132588 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe5755-78c4-4ece-b3fc-e4e08140a8b0 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:29.138334 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defe4a4b0b644b1eb9ec57f1b3a364ab'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:29.145298 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defe4a4b0b644b1eb9ec57f1b3a364ab'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:29.193125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe5755-78c4-4ece-b3fc-e4e08140a8b0 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:29.198181 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:29.198951 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.199312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.199690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.200450 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:29.202483 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:29.218079 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defe4a4b0b644b1eb9ec57f1b3a364ab'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:29.218709 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defe4a4b0b644b1eb9ec57f1b3a364ab'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:29.219326 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b31e9e05-8181-4ba8-b89c-b6ec90190a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defe4a4b0b644b1eb9ec57f1b3a364ab'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:29.237732 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1410/2808] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:28 2022] DELETE /identity/v3/users/defe4a4b0b644b1eb9ec57f1b3a364ab => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:29.242069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb169-3749-4c41-820a-cd77ba0cc8d4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.242368 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb169-3749-4c41-820a-cd77ba0cc8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.242651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb169-3749-4c41-820a-cd77ba0cc8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.259313 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e0acb169-3749-4c41-820a-cd77ba0cc8d4 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:29.260520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e0acb169-3749-4c41-820a-cd77ba0cc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:29.308981 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1399/2809] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:29 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:26:29.313585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:29.314839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:29.318695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1411/2810] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:29.326846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879860b-48f3-45a6-8096-a57585c7d903 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:29.328396 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb169-3749-4c41-820a-cd77ba0cc8d4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:29.329897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e0acb169-3749-4c41-820a-cd77ba0cc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:29.332871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127bc2b-4757-4714-8df4-cebe6fc78ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:29.333533 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127bc2b-4757-4714-8df4-cebe6fc78ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.333818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127bc2b-4757-4714-8df4-cebe6fc78ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.334140 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127bc2b-4757-4714-8df4-cebe6fc78ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.334914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127bc2b-4757-4714-8df4-cebe6fc78ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:29.336503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127bc2b-4757-4714-8df4-cebe6fc78ab6 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:29.347383 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1400/2811] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:29.351299 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127bc2b-4757-4714-8df4-cebe6fc78ab6 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:29.361249 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127bc2b-4757-4714-8df4-cebe6fc78ab6 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:29.365980 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeea3d-9f01-4039-8ec5-89064081cd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:29.366627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeea3d-9f01-4039-8ec5-89064081cd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.366914 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeea3d-9f01-4039-8ec5-89064081cd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.369439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeea3d-9f01-4039-8ec5-89064081cd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.369439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaeea3d-9f01-4039-8ec5-89064081cd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:29.369439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaeea3d-9f01-4039-8ec5-89064081cd1f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:29.379897 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1401/2812] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:29.383942 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeea3d-9f01-4039-8ec5-89064081cd1f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:29.389358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb169-3749-4c41-820a-cd77ba0cc8d4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:29.393560 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeea3d-9f01-4039-8ec5-89064081cd1f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:29.393688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307068d-c17c-4d2a-8d29-7f638bdced07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:29.394304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307068d-c17c-4d2a-8d29-7f638bdced07 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.394693 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307068d-c17c-4d2a-8d29-7f638bdced07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.398102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307068d-c17c-4d2a-8d29-7f638bdced07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.398484 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:29.399398 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.399761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.400044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] PATH_INFO: `/v3/projects/dcf949efc9d8439686636d833c827b20/users/eba244f5df6449af8914c340cfd3f6f6/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.407769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307068d-c17c-4d2a-8d29-7f638bdced07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:29.411344 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307068d-c17c-4d2a-8d29-7f638bdced07 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:29.421841 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:29.426245 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1412/2813] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 30 12:26:29.428542 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf949efc9d8439686636d833c827b20, user_id=eba244f5df6449af8914c340cfd3f6f6, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:29.431436 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:29.504765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1402/2814] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:29 2022] PUT /identity/v3/projects/dcf949efc9d8439686636d833c827b20/users/eba244f5df6449af8914c340cfd3f6f6/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:29.515580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef571-fa8c-4284-bf37-c8deac0b1640 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.515874 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef571-fa8c-4284-bf37-c8deac0b1640 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.516177 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef571-fa8c-4284-bf37-c8deac0b1640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.530083 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:29.545147 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-065ef571-fa8c-4284-bf37-c8deac0b1640 None None] MFA Rules not processed for user `eba244f5df6449af8914c340cfd3f6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:29.546424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-065ef571-fa8c-4284-bf37-c8deac0b1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:29.611103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1413/2815] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:26:29.623266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:29.624820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:29.686133 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92fcaf-59fc-4fda-980e-726bc6ac1ab4 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:29.690541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04571e-f252-48b1-ad05-3e0ecdbbfda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:29.691191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04571e-f252-48b1-ad05-3e0ecdbbfda0 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.691503 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04571e-f252-48b1-ad05-3e0ecdbbfda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.691787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04571e-f252-48b1-ad05-3e0ecdbbfda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.700600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04571e-f252-48b1-ad05-3e0ecdbbfda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:29.702161 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04571e-f252-48b1-ad05-3e0ecdbbfda0 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:29.711348 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1403/2816] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:29.837297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ef571-fa8c-4284-bf37-c8deac0b1640 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:29.838762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-065ef571-fa8c-4284-bf37-c8deac0b1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:29.913698 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ef571-fa8c-4284-bf37-c8deac0b1640 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:29.918856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:29.919723 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:29.920013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:29.920285 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] PATH_INFO: `/v3/projects/b2f88f465cae46c593f3339b7bef3614` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:29.921983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f88f465cae46c593f3339b7bef3614)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:29.923972 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:30.070899 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f88f465cae46c593f3339b7bef3614', 'request_id': 'req-383446dc-ae2f-48b6-bf8f-c51e764a0d51'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.195121 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f88f465cae46c593f3339b7bef3614', 'request_id': 'req-383446dc-ae2f-48b6-bf8f-c51e764a0d51'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.201901 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f88f465cae46c593f3339b7bef3614', 'request_id': 'req-383446dc-ae2f-48b6-bf8f-c51e764a0d51'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.213018 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] The token cache is being invalidate because project b2f88f465cae46c593f3339b7bef3614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:30.213359 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.214044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.216074 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1414/2817] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:29 2022] DELETE /identity/v3/projects/b2f88f465cae46c593f3339b7bef3614 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:30.220045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04571e-f252-48b1-ad05-3e0ecdbbfda0 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:30.231342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04571e-f252-48b1-ad05-3e0ecdbbfda0 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:30.286832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:30.287702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:30.291678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:30.291678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] PATH_INFO: `/v3/users/cd55624e83e1427096fcbd3e6930ff2b` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:30.291678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd55624e83e1427096fcbd3e6930ff2b)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:30.291678 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:30.497078 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd55624e83e1427096fcbd3e6930ff2b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.505778 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd55624e83e1427096fcbd3e6930ff2b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.506523 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd55624e83e1427096fcbd3e6930ff2b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.507138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd55624e83e1427096fcbd3e6930ff2b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.590454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a65d7d8a-e6f2-4b71-8edb-c6b17788e8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd55624e83e1427096fcbd3e6930ff2b'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:30.608750 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1404/2818] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:30 2022] DELETE /identity/v3/users/cd55624e83e1427096fcbd3e6930ff2b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:31.077864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:31.079533 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:31.093167 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383446dc-ae2f-48b6-bf8f-c51e764a0d51 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:31.118913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:31.157473 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:31.158371 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:31.158654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:31.158929 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] PATH_INFO: `/v3/projects/6cdb066a28f0487dad6f0a9a2c12a907` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:31.160125 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdb066a28f0487dad6f0a9a2c12a907)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:31.162092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:31.286429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdb066a28f0487dad6f0a9a2c12a907', 'request_id': 'req-3afe9c21-d9aa-44c7-9470-acca972b2d23'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:31.382293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdb066a28f0487dad6f0a9a2c12a907', 'request_id': 'req-3afe9c21-d9aa-44c7-9470-acca972b2d23'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:31.389808 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdb066a28f0487dad6f0a9a2c12a907', 'request_id': 'req-3afe9c21-d9aa-44c7-9470-acca972b2d23'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:31.400475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] The token cache is being invalidate because project 6cdb066a28f0487dad6f0a9a2c12a907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:31.400769 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:31.401419 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3afe9c21-d9aa-44c7-9470-acca972b2d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:31.403862 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1415/2819] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:31 2022] DELETE /identity/v3/projects/6cdb066a28f0487dad6f0a9a2c12a907 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:31.409613 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01fdb-8f23-47d5-ad85-e43036e52377 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:31.410112 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01fdb-8f23-47d5-ad85-e43036e52377 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:31.410215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01fdb-8f23-47d5-ad85-e43036e52377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:31.427290 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-efc01fdb-8f23-47d5-ad85-e43036e52377 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:31.428442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-efc01fdb-8f23-47d5-ad85-e43036e52377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:31.436957 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:31.489810 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1405/2820] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:31.498543 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3e7c-ec26-438a-95e0-d6b2df45cd50 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:31.498832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3e7c-ec26-438a-95e0-d6b2df45cd50 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:31.499117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3e7c-ec26-438a-95e0-d6b2df45cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:31.525057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-552f3e7c-ec26-438a-95e0-d6b2df45cd50 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:31.525057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-552f3e7c-ec26-438a-95e0-d6b2df45cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:31.529860 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1416/2821] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:31.534346 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc01fdb-8f23-47d5-ad85-e43036e52377 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:31.543773 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc01fdb-8f23-47d5-ad85-e43036e52377 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:31.548610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:31.549284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:31.549568 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:31.549848 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:31.550605 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80343) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:26:31.550915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:31.552561 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:31.564697 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1406/2822] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 30 12:26:31.569044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f3e7c-ec26-438a-95e0-d6b2df45cd50 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:31.579267 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f3e7c-ec26-438a-95e0-d6b2df45cd50 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:31.583968 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6947e3-b0a4-4da9-ade7-9f8e0c4ea03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:31.584617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6947e3-b0a4-4da9-ade7-9f8e0c4ea03c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:31.584907 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6947e3-b0a4-4da9-ade7-9f8e0c4ea03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:31.585184 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6947e3-b0a4-4da9-ade7-9f8e0c4ea03c admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:31.585880 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6947e3-b0a4-4da9-ade7-9f8e0c4ea03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:31.587893 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6947e3-b0a4-4da9-ade7-9f8e0c4ea03c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:31.679900 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1417/2823] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:31 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:31.684616 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:31.694322 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082db7c-cc7b-450b-8855-2ca62672ff5a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:31.749557 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b78c-296c-46b1-9031-8b362c88b7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:31.750277 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b78c-296c-46b1-9031-8b362c88b7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:31.750566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b78c-296c-46b1-9031-8b362c88b7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:31.750846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b78c-296c-46b1-9031-8b362c88b7cb admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:31.751612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93b78c-296c-46b1-9031-8b362c88b7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:31.753607 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93b78c-296c-46b1-9031-8b362c88b7cb admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:31.905682 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1407/2824] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:31 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:31.909805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6947e3-b0a4-4da9-ade7-9f8e0c4ea03c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:31.922741 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6947e3-b0a4-4da9-ade7-9f8e0c4ea03c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:31.927915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4a647-3744-4996-9393-01c24e5d4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:31.928833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a647-3744-4996-9393-01c24e5d4767 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:31.929221 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a647-3744-4996-9393-01c24e5d4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:31.929697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a647-3744-4996-9393-01c24e5d4767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:31.930802 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4a647-3744-4996-9393-01c24e5d4767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:31.932761 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4a647-3744-4996-9393-01c24e5d4767 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:31.949594 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1418/2825] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:31.950726 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b78c-296c-46b1-9031-8b362c88b7cb admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:31.961115 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b78c-296c-46b1-9031-8b362c88b7cb admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:31.966191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867af84-5ea4-49f8-8fb8-16f5fcc0f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:31.969604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867af84-5ea4-49f8-8fb8-16f5fcc0f700 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:31.969604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867af84-5ea4-49f8-8fb8-16f5fcc0f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:31.969604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867af84-5ea4-49f8-8fb8-16f5fcc0f700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:31.969604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867af84-5ea4-49f8-8fb8-16f5fcc0f700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:31.970279 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867af84-5ea4-49f8-8fb8-16f5fcc0f700 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:31.979975 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1408/2826] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:31.984606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4a647-3744-4996-9393-01c24e5d4767 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:31.994983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4a647-3744-4996-9393-01c24e5d4767 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:32.000438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7daa5c-c950-478d-b435-e584fdee8342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:32.001340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7daa5c-c950-478d-b435-e584fdee8342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.001630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7daa5c-c950-478d-b435-e584fdee8342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.001911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7daa5c-c950-478d-b435-e584fdee8342 admin admin] PATH_INFO: `/v3/projects/4809afe9386b4169bfea73a9a52f388f/users/da8685b34f9d4402bdf415f9644426e4/roles/ec78785738f441ec9be64e122e252506` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.016978 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7daa5c-c950-478d-b435-e584fdee8342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4809afe9386b4169bfea73a9a52f388f, user_id=da8685b34f9d4402bdf415f9644426e4, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:32.019777 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7daa5c-c950-478d-b435-e584fdee8342 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:32.110309 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1419/2827] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:31 2022] PUT /identity/v3/projects/4809afe9386b4169bfea73a9a52f388f/users/da8685b34f9d4402bdf415f9644426e4/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:32.120600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cff8d-2b42-431d-ba27-d12c9c7678a5 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.120918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cff8d-2b42-431d-ba27-d12c9c7678a5 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.121877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cff8d-2b42-431d-ba27-d12c9c7678a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.148765 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-bc1cff8d-2b42-431d-ba27-d12c9c7678a5 None None] MFA Rules not processed for user `da8685b34f9d4402bdf415f9644426e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:32.150022 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bc1cff8d-2b42-431d-ba27-d12c9c7678a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:32.215254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1409/2828] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:32.219800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7daa5c-c950-478d-b435-e584fdee8342 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:32.268103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:32.281695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7daa5c-c950-478d-b435-e584fdee8342 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:32.286420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27e223-3bf1-4dde-b664-0a57208892aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:32.287072 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27e223-3bf1-4dde-b664-0a57208892aa admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.287358 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27e223-3bf1-4dde-b664-0a57208892aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.287635 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27e223-3bf1-4dde-b664-0a57208892aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.288345 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27e223-3bf1-4dde-b664-0a57208892aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:32.290287 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27e223-3bf1-4dde-b664-0a57208892aa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:32.372305 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1420/2829] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:32 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:26:32.376215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cff8d-2b42-431d-ba27-d12c9c7678a5 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:32.387061 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cff8d-2b42-431d-ba27-d12c9c7678a5 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:32.392154 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:32.445377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b7e4-d557-469b-b4e9-23eb94730d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:32.446104 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b7e4-d557-469b-b4e9-23eb94730d4f admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.446392 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b7e4-d557-469b-b4e9-23eb94730d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.446673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b7e4-d557-469b-b4e9-23eb94730d4f admin admin] PATH_INFO: `/v3/users` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.447381 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b7e4-d557-469b-b4e9-23eb94730d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:32.449327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b7e4-d557-469b-b4e9-23eb94730d4f admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:32.548700 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1410/2830] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:32 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:32.552736 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27e223-3bf1-4dde-b664-0a57208892aa admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:32.562999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27e223-3bf1-4dde-b664-0a57208892aa admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:32.567580 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28ed3d-a271-4796-93b2-cd3ce371120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:32.568236 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28ed3d-a271-4796-93b2-cd3ce371120a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.568524 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28ed3d-a271-4796-93b2-cd3ce371120a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.568803 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28ed3d-a271-4796-93b2-cd3ce371120a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.569545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28ed3d-a271-4796-93b2-cd3ce371120a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:32.571272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28ed3d-a271-4796-93b2-cd3ce371120a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:32.590671 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1421/2831] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:32.591658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b7e4-d557-469b-b4e9-23eb94730d4f admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:32.602481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b7e4-d557-469b-b4e9-23eb94730d4f admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:32.608036 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849e9f-1f19-4fa8-add6-0135a1f1975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:32.608935 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849e9f-1f19-4fa8-add6-0135a1f1975a admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.609276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849e9f-1f19-4fa8-add6-0135a1f1975a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.609524 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849e9f-1f19-4fa8-add6-0135a1f1975a admin admin] PATH_INFO: `/v3/projects/9f3236556abc4e4da98b121238c49489/users/72ddc0f6d09d4a55a5ded2a6aea62424/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.624338 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849e9f-1f19-4fa8-add6-0135a1f1975a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3236556abc4e4da98b121238c49489, user_id=72ddc0f6d09d4a55a5ded2a6aea62424, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:32.627052 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849e9f-1f19-4fa8-add6-0135a1f1975a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:32.722184 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1411/2832] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:32 2022] PUT /identity/v3/projects/9f3236556abc4e4da98b121238c49489/users/72ddc0f6d09d4a55a5ded2a6aea62424/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:26:32.726559 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28ed3d-a271-4796-93b2-cd3ce371120a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:32.740102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28ed3d-a271-4796-93b2-cd3ce371120a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:32.797480 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99dbf-beb7-4e74-95b0-b4787b9eb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:32.798207 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99dbf-beb7-4e74-95b0-b4787b9eb65b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.798520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99dbf-beb7-4e74-95b0-b4787b9eb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.798800 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99dbf-beb7-4e74-95b0-b4787b9eb65b admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.799526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef99dbf-beb7-4e74-95b0-b4787b9eb65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:32.801124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef99dbf-beb7-4e74-95b0-b4787b9eb65b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:32.810554 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1422/2833] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:32.814809 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849e9f-1f19-4fa8-add6-0135a1f1975a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:32.825693 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849e9f-1f19-4fa8-add6-0135a1f1975a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:32.830382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:32.831254 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.831538 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.831813 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] PATH_INFO: `/v3/projects/9f3236556abc4e4da98b121238c49489/users/72ddc0f6d09d4a55a5ded2a6aea62424/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.833752 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3236556abc4e4da98b121238c49489, user_id=72ddc0f6d09d4a55a5ded2a6aea62424, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:32.836407 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:32.847508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1412/2834] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:32 2022] PUT /identity/v3/projects/9f3236556abc4e4da98b121238c49489/users/72ddc0f6d09d4a55a5ded2a6aea62424/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:32.858658 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb49f2f-981a-4858-a492-c79eceaee0f7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:32.858953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb49f2f-981a-4858-a492-c79eceaee0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:32.859260 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb49f2f-981a-4858-a492-c79eceaee0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:32.885357 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1eb49f2f-981a-4858-a492-c79eceaee0f7 None None] MFA Rules not processed for user `72ddc0f6d09d4a55a5ded2a6aea62424`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:32.887094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1eb49f2f-981a-4858-a492-c79eceaee0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:32.957431 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1423/2835] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:32.969076 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:32.970843 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:33.035280 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afaf17-de5b-4ae5-8493-53f3e7ad3ce1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:33.039019 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc9940-d532-4007-83fe-86df52939a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:33.039673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc9940-d532-4007-83fe-86df52939a1d service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:33.039964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc9940-d532-4007-83fe-86df52939a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:33.040248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc9940-d532-4007-83fe-86df52939a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:33.049310 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc9940-d532-4007-83fe-86df52939a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:33.050772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc9940-d532-4007-83fe-86df52939a1d service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:33.060692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1413/2836] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:33.088688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb49f2f-981a-4858-a492-c79eceaee0f7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:33.133520 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:33.150612 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb49f2f-981a-4858-a492-c79eceaee0f7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:33.155564 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:33.156443 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:33.156727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:33.157006 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] PATH_INFO: `/v3/users/da8685b34f9d4402bdf415f9644426e4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:33.158232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8685b34f9d4402bdf415f9644426e4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:33.160257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:33.418894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8685b34f9d4402bdf415f9644426e4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:33.425909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8685b34f9d4402bdf415f9644426e4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:33.532116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8685b34f9d4402bdf415f9644426e4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:33.532740 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8685b34f9d4402bdf415f9644426e4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:33.533446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8685b34f9d4402bdf415f9644426e4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:33.553102 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1424/2837] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:33 2022] DELETE /identity/v3/users/da8685b34f9d4402bdf415f9644426e4 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:33.557856 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4162139-16e4-49ef-b380-59ab37049f03 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:33.559079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4162139-16e4-49ef-b380-59ab37049f03 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:33.559079 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4162139-16e4-49ef-b380-59ab37049f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:33.575983 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-e4162139-16e4-49ef-b380-59ab37049f03 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:33.577237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e4162139-16e4-49ef-b380-59ab37049f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:33.636859 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1414/2838] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:33.647132 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:33.651640 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:33.715349 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcec0f-4c71-4e72-961b-c4942d4a1b73 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:33.718986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5148b1-2fac-440f-96d9-cf98095394cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:33.719633 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5148b1-2fac-440f-96d9-cf98095394cf service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:33.719922 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5148b1-2fac-440f-96d9-cf98095394cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:33.720204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5148b1-2fac-440f-96d9-cf98095394cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:33.729128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5148b1-2fac-440f-96d9-cf98095394cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:33.730762 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5148b1-2fac-440f-96d9-cf98095394cf service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:33.740449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1425/2839] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:34.144217 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4162139-16e4-49ef-b380-59ab37049f03 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:34.146095 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e4162139-16e4-49ef-b380-59ab37049f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:34.154621 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:34.158511 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4162139-16e4-49ef-b380-59ab37049f03 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:34.163025 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:34.163889 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:34.164171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:34.164448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] PATH_INFO: `/v3/projects/4809afe9386b4169bfea73a9a52f388f` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:34.165619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4809afe9386b4169bfea73a9a52f388f)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:34.167565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:34.319526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4809afe9386b4169bfea73a9a52f388f', 'request_id': 'req-49cdb496-295c-42e1-bf20-45f96ab57eae'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.326574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4809afe9386b4169bfea73a9a52f388f', 'request_id': 'req-49cdb496-295c-42e1-bf20-45f96ab57eae'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.478817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4809afe9386b4169bfea73a9a52f388f', 'request_id': 'req-49cdb496-295c-42e1-bf20-45f96ab57eae'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.478817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] The token cache is being invalidate because project 4809afe9386b4169bfea73a9a52f388f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:34.478817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.478817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.478817 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1415/2840] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:34 2022] DELETE /identity/v3/projects/4809afe9386b4169bfea73a9a52f388f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:34.481017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5148b1-2fac-440f-96d9-cf98095394cf service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:34.491017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5148b1-2fac-440f-96d9-cf98095394cf service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:34.549593 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:34.550494 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:34.550776 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:34.551047 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] PATH_INFO: `/v3/users/72ddc0f6d09d4a55a5ded2a6aea62424` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:34.552277 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ddc0f6d09d4a55a5ded2a6aea62424)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:34.554244 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:34.559970 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:34.760275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ddc0f6d09d4a55a5ded2a6aea62424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.769450 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ddc0f6d09d4a55a5ded2a6aea62424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.887217 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ddc0f6d09d4a55a5ded2a6aea62424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.887872 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ddc0f6d09d4a55a5ded2a6aea62424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.888561 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e4428f2d-938d-4f21-af59-b532a3c79a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ddc0f6d09d4a55a5ded2a6aea62424'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:34.924636 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1426/2841] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:34 2022] DELETE /identity/v3/users/72ddc0f6d09d4a55a5ded2a6aea62424 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:35.345610 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:35.347116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:35.377209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdb496-295c-42e1-bf20-45f96ab57eae admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:35.430657 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:35.431541 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:35.431847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:35.432464 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] PATH_INFO: `/v3/projects/9f3236556abc4e4da98b121238c49489` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:35.433761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3236556abc4e4da98b121238c49489)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:35.435768 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:35.578984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3236556abc4e4da98b121238c49489', 'request_id': 'req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:35.585255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3236556abc4e4da98b121238c49489', 'request_id': 'req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:35.685144 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3236556abc4e4da98b121238c49489', 'request_id': 'req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:35.696046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] The token cache is being invalidate because project 9f3236556abc4e4da98b121238c49489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:35.696361 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:35.696964 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-a01bbda0-581a-4af7-af37-c2cd4e45b0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:35.698565 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1416/2842] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:35 2022] DELETE /identity/v3/projects/9f3236556abc4e4da98b121238c49489 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:35.704027 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58c13-be05-4d32-b4fe-d57a721f5777 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:35.704507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58c13-be05-4d32-b4fe-d57a721f5777 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:35.704722 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a58c13-be05-4d32-b4fe-d57a721f5777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:35.723210 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b6a58c13-be05-4d32-b4fe-d57a721f5777 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:35.724489 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b6a58c13-be05-4d32-b4fe-d57a721f5777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:35.785915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1427/2843] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:35.793828 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92c9e-2906-4555-96aa-1db01b2f7e0c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:35.794164 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92c9e-2906-4555-96aa-1db01b2f7e0c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:35.794449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92c9e-2906-4555-96aa-1db01b2f7e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:35.812499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-11f92c9e-2906-4555-96aa-1db01b2f7e0c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:35.813690 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-11f92c9e-2906-4555-96aa-1db01b2f7e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:35.823138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1417/2844] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:35.829094 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a58c13-be05-4d32-b4fe-d57a721f5777 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:35.839438 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a58c13-be05-4d32-b4fe-d57a721f5777 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:35.846281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:35.849462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:35.849462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:35.849462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:35.849462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:26:35.849462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:35.850574 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:35.863629 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1428/2845] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:26:35.867746 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f92c9e-2906-4555-96aa-1db01b2f7e0c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:35.878901 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f92c9e-2906-4555-96aa-1db01b2f7e0c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:35.884584 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31497ee8-3988-4aa8-8bd6-5b572cc08c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:35.885256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31497ee8-3988-4aa8-8bd6-5b572cc08c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:35.885548 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31497ee8-3988-4aa8-8bd6-5b572cc08c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:35.885833 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31497ee8-3988-4aa8-8bd6-5b572cc08c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:35.887067 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31497ee8-3988-4aa8-8bd6-5b572cc08c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:35.889018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31497ee8-3988-4aa8-8bd6-5b572cc08c40 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:35.897775 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:36.030840 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:36.045656 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1418/2846] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:35 2022] POST /identity/v3/projects => generated 395 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:36.051654 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd97b0-9062-4ee0-85c3-7146c365c92f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:36.114449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a33fa7-8dcc-40eb-92f8-63d830b5f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:36.115229 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33fa7-8dcc-40eb-92f8-63d830b5f7af admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:36.115492 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33fa7-8dcc-40eb-92f8-63d830b5f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:36.115783 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33fa7-8dcc-40eb-92f8-63d830b5f7af admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:36.116495 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a33fa7-8dcc-40eb-92f8-63d830b5f7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:36.118467 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a33fa7-8dcc-40eb-92f8-63d830b5f7af admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:36.273064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1429/2847] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:36 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:26:36.274120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31497ee8-3988-4aa8-8bd6-5b572cc08c40 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:36.285677 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31497ee8-3988-4aa8-8bd6-5b572cc08c40 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:36.290508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964ec9-066a-419d-8d23-61ca9134257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:36.294632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964ec9-066a-419d-8d23-61ca9134257e admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:36.294632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964ec9-066a-419d-8d23-61ca9134257e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:36.294632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964ec9-066a-419d-8d23-61ca9134257e admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:36.294632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62964ec9-066a-419d-8d23-61ca9134257e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:36.294632 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62964ec9-066a-419d-8d23-61ca9134257e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:36.304469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1419/2848] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:36.308185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a33fa7-8dcc-40eb-92f8-63d830b5f7af admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:36.314198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:36.319410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a33fa7-8dcc-40eb-92f8-63d830b5f7af admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:36.324906 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebda2ba-ccbb-443b-bdbf-7740f975e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:36.327271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebda2ba-ccbb-443b-bdbf-7740f975e383 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:36.327271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebda2ba-ccbb-443b-bdbf-7740f975e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:36.327271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebda2ba-ccbb-443b-bdbf-7740f975e383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:36.327271 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebda2ba-ccbb-443b-bdbf-7740f975e383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:36.328576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebda2ba-ccbb-443b-bdbf-7740f975e383 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:36.342332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1430/2849] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:36.344062 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964ec9-066a-419d-8d23-61ca9134257e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:36.354284 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964ec9-066a-419d-8d23-61ca9134257e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:36.359543 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06845823-c130-4bbb-936f-f0e2e4e225b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:36.360432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06845823-c130-4bbb-936f-f0e2e4e225b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:36.360715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06845823-c130-4bbb-936f-f0e2e4e225b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:36.361027 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06845823-c130-4bbb-936f-f0e2e4e225b8 admin admin] PATH_INFO: `/v3/projects/2aa0ad3377fe4fde828273a0c4874122/users/30fc3e8da26d4079bfba618de56012fa/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:36.376601 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06845823-c130-4bbb-936f-f0e2e4e225b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa0ad3377fe4fde828273a0c4874122, user_id=30fc3e8da26d4079bfba618de56012fa, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:36.380847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06845823-c130-4bbb-936f-f0e2e4e225b8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:36.476377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1420/2850] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:36 2022] PUT /identity/v3/projects/2aa0ad3377fe4fde828273a0c4874122/users/30fc3e8da26d4079bfba618de56012fa/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:36.487057 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9e0d-392a-43ff-a298-04d28af737ce None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:36.487442 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9e0d-392a-43ff-a298-04d28af737ce None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:36.487647 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9e0d-392a-43ff-a298-04d28af737ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:36.515406 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e7ea9e0d-392a-43ff-a298-04d28af737ce None None] MFA Rules not processed for user `30fc3e8da26d4079bfba618de56012fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:36.516620 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e7ea9e0d-392a-43ff-a298-04d28af737ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:36.586953 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1431/2851] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:36.591676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06845823-c130-4bbb-936f-f0e2e4e225b8 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:36.655763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06845823-c130-4bbb-936f-f0e2e4e225b8 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:36.660419 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cdc40-ca49-4be4-954d-cbc7b848f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:36.661077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cdc40-ca49-4be4-954d-cbc7b848f5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:36.661362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cdc40-ca49-4be4-954d-cbc7b848f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:36.661638 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cdc40-ca49-4be4-954d-cbc7b848f5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:36.662406 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cdc40-ca49-4be4-954d-cbc7b848f5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:36.664301 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cdc40-ca49-4be4-954d-cbc7b848f5a4 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:36.768846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1421/2852] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:36 2022] POST /identity/v3/projects => generated 401 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:36.773054 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea9e0d-392a-43ff-a298-04d28af737ce None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:36.784896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea9e0d-392a-43ff-a298-04d28af737ce None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:36.841553 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896c741-e1d6-4b70-bffa-9f1bbd305d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:36.842246 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896c741-e1d6-4b70-bffa-9f1bbd305d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:36.842531 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896c741-e1d6-4b70-bffa-9f1bbd305d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:36.842805 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896c741-e1d6-4b70-bffa-9f1bbd305d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:36.843498 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896c741-e1d6-4b70-bffa-9f1bbd305d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:36.845552 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896c741-e1d6-4b70-bffa-9f1bbd305d7c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:36.949012 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1432/2853] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:36 2022] POST /identity/v3/users => generated 307 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:36.953125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cdc40-ca49-4be4-954d-cbc7b848f5a4 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:36.963485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cdc40-ca49-4be4-954d-cbc7b848f5a4 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:36.968555 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc1df1-8256-48a3-8e39-afa82e639fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:36.969210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1df1-8256-48a3-8e39-afa82e639fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:36.969499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1df1-8256-48a3-8e39-afa82e639fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:36.969826 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1df1-8256-48a3-8e39-afa82e639fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:36.970583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc1df1-8256-48a3-8e39-afa82e639fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:36.972191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc1df1-8256-48a3-8e39-afa82e639fb1 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:36.983529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1422/2854] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 30 12:26:36.987651 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896c741-e1d6-4b70-bffa-9f1bbd305d7c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:36.997478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896c741-e1d6-4b70-bffa-9f1bbd305d7c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:37.002034 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae575-b5aa-4820-bed9-a676497b5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:37.002903 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae575-b5aa-4820-bed9-a676497b5e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:37.003181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae575-b5aa-4820-bed9-a676497b5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:37.003455 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ae575-b5aa-4820-bed9-a676497b5e01 admin admin] PATH_INFO: `/v3/projects/df8448eba39a48cb8e8dd7c0c15caae1/users/bc708c343a6642cf992127c0fd75338d/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:37.017673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ae575-b5aa-4820-bed9-a676497b5e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8448eba39a48cb8e8dd7c0c15caae1, user_id=bc708c343a6642cf992127c0fd75338d, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:37.020351 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ae575-b5aa-4820-bed9-a676497b5e01 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:37.092779 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1433/2855] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:36 2022] PUT /identity/v3/projects/df8448eba39a48cb8e8dd7c0c15caae1/users/bc708c343a6642cf992127c0fd75338d/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:37.096928 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc1df1-8256-48a3-8e39-afa82e639fb1 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:37.107918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc1df1-8256-48a3-8e39-afa82e639fb1 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:37.163849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de0dd-05fa-4ead-8589-71f66438838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:37.164531 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de0dd-05fa-4ead-8589-71f66438838a admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:37.164806 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de0dd-05fa-4ead-8589-71f66438838a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:37.165084 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de0dd-05fa-4ead-8589-71f66438838a admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:37.165840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de0dd-05fa-4ead-8589-71f66438838a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:37.167482 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de0dd-05fa-4ead-8589-71f66438838a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:37.177237 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1423/2856] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:37.181505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae575-b5aa-4820-bed9-a676497b5e01 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:37.192307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ae575-b5aa-4820-bed9-a676497b5e01 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:37.196894 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:37.197768 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:37.198272 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:37.198563 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] PATH_INFO: `/v3/projects/df8448eba39a48cb8e8dd7c0c15caae1/users/bc708c343a6642cf992127c0fd75338d/roles/f3f138e4021a4b7dada39089dd427266` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:37.201016 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8448eba39a48cb8e8dd7c0c15caae1, user_id=bc708c343a6642cf992127c0fd75338d, role_id=f3f138e4021a4b7dada39089dd427266)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:37.203725 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:37.213944 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1434/2857] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:37 2022] PUT /identity/v3/projects/df8448eba39a48cb8e8dd7c0c15caae1/users/bc708c343a6642cf992127c0fd75338d/roles/f3f138e4021a4b7dada39089dd427266 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:37.225652 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d6052-cfdd-4ebb-bb41-983dfe66cc68 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:37.225945 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d6052-cfdd-4ebb-bb41-983dfe66cc68 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:37.226255 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d6052-cfdd-4ebb-bb41-983dfe66cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:37.258644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-635d6052-cfdd-4ebb-bb41-983dfe66cc68 None None] MFA Rules not processed for user `bc708c343a6642cf992127c0fd75338d`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:37.258644 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-635d6052-cfdd-4ebb-bb41-983dfe66cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:37.269148 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:37.327248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1424/2858] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:37.337778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:37.340086 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:37.378020 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:37.400731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27677b79-49c1-4e0f-b1f0-dbad50a9e1ae admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:37.405377 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:37.406061 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:37.406350 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:37.406628 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:37.415588 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:37.417042 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:37.426265 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1435/2859] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:37.651337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d6052-cfdd-4ebb-bb41-983dfe66cc68 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:37.652702 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-635d6052-cfdd-4ebb-bb41-983dfe66cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:37.664976 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d6052-cfdd-4ebb-bb41-983dfe66cc68 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:37.668793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a32e1-2d38-47d7-9186-f25771a388bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:37.669485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a32e1-2d38-47d7-9186-f25771a388bb service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:37.669772 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a32e1-2d38-47d7-9186-f25771a388bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:37.670094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a32e1-2d38-47d7-9186-f25771a388bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:37.735044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a32e1-2d38-47d7-9186-f25771a388bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:37.736732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a32e1-2d38-47d7-9186-f25771a388bb service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:37.747021 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1425/2860] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:38.733336 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:38.734827 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:38.798598 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a662-af97-4390-87eb-1ac87bc5257c service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:38.803117 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:38.803981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:38.804269 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:38.804551 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] PATH_INFO: `/v3/users/bd30f6286c314980901ed496d4ada983` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:38.805727 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd30f6286c314980901ed496d4ada983)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:38.807701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:39.036169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd30f6286c314980901ed496d4ada983'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:39.042880 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd30f6286c314980901ed496d4ada983'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:39.142452 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd30f6286c314980901ed496d4ada983'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:39.143211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd30f6286c314980901ed496d4ada983'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:39.144188 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd30f6286c314980901ed496d4ada983'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:39.164092 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1436/2861] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:38 2022] DELETE /identity/v3/users/bd30f6286c314980901ed496d4ada983 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:39.168562 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1f339-faa6-47b5-a06d-a28d8394473c None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:39.169044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1f339-faa6-47b5-a06d-a28d8394473c None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:39.169145 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1f339-faa6-47b5-a06d-a28d8394473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:39.185868 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-eaf1f339-faa6-47b5-a06d-a28d8394473c None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:39.187092 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-eaf1f339-faa6-47b5-a06d-a28d8394473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:39.245839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1426/2862] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:39.255415 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:39.257208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:39.316497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac7c5-38b2-4874-8c57-08ebec5504bd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:39.320075 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:39.320714 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:39.320996 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:39.321270 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:39.331550 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:39.333000 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:39.336973 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:39.344030 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1437/2863] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:39.763953 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1f339-faa6-47b5-a06d-a28d8394473c None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:39.765499 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-eaf1f339-faa6-47b5-a06d-a28d8394473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:39.778878 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1f339-faa6-47b5-a06d-a28d8394473c None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:39.783793 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:39.784747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:39.785508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:39.785508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] PATH_INFO: `/v3/projects/895cac3acf584dc1ab220d5f9d91a471` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:39.786709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895cac3acf584dc1ab220d5f9d91a471)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:39.794011 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:39.935441 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:39.939327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895cac3acf584dc1ab220d5f9d91a471', 'request_id': 'req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:39.945687 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895cac3acf584dc1ab220d5f9d91a471', 'request_id': 'req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:40.051912 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895cac3acf584dc1ab220d5f9d91a471', 'request_id': 'req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:40.063313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] The token cache is being invalidate because project 895cac3acf584dc1ab220d5f9d91a471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:40.063673 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:40.064313 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-4fb9a3f4-ab5a-4f12-bfe2-29346d5d68e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:40.066328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1427/2864] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:39 2022] DELETE /identity/v3/projects/895cac3acf584dc1ab220d5f9d91a471 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:41.307193 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:41.307664 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:41.320138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd14806-ca28-4229-b4fb-3d035a08dcd3 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:41.379113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:41.380085 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:41.380374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:41.380659 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] PATH_INFO: `/v3/users/eba244f5df6449af8914c340cfd3f6f6` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:41.381884 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba244f5df6449af8914c340cfd3f6f6)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:41.384010 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:41.619673 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba244f5df6449af8914c340cfd3f6f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:41.627053 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba244f5df6449af8914c340cfd3f6f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:41.720529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba244f5df6449af8914c340cfd3f6f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:41.721168 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba244f5df6449af8914c340cfd3f6f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:41.721789 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba244f5df6449af8914c340cfd3f6f6'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:41.739843 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1438/2865] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:41 2022] DELETE /identity/v3/users/eba244f5df6449af8914c340cfd3f6f6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:41.744444 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55afae-4a26-47ea-820b-0a06fec64545 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:41.744939 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55afae-4a26-47ea-820b-0a06fec64545 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:41.745072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55afae-4a26-47ea-820b-0a06fec64545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:41.764312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-4c55afae-4a26-47ea-820b-0a06fec64545 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:41.765559 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4c55afae-4a26-47ea-820b-0a06fec64545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:41.825454 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1428/2866] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:41.835255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:41.836642 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:41.894169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac49cd-20eb-4943-b57d-7e3a9a2ee93e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:41.897731 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:41.898403 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:41.898701 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:41.898984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:41.908211 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:41.909706 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:41.919385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1439/2867] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:42.343545 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55afae-4a26-47ea-820b-0a06fec64545 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:42.345018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-4c55afae-4a26-47ea-820b-0a06fec64545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:42.358604 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55afae-4a26-47ea-820b-0a06fec64545 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:42.363926 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:42.364794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:42.365075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:42.365349 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] PATH_INFO: `/v3/projects/dcf949efc9d8439686636d833c827b20` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:42.366634 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf949efc9d8439686636d833c827b20)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:42.368572 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:42.492692 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf949efc9d8439686636d833c827b20', 'request_id': 'req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:42.498990 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf949efc9d8439686636d833c827b20', 'request_id': 'req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:42.593486 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf949efc9d8439686636d833c827b20', 'request_id': 'req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:42.605774 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] The token cache is being invalidate because project dcf949efc9d8439686636d833c827b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:42.606103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:42.606738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-3208f58f-25ab-4c10-a7ff-aed574a4a7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:42.608266 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1429/2868] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:42 2022] DELETE /identity/v3/projects/dcf949efc9d8439686636d833c827b20 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:42.718482 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:42.720076 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:42.734603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8704b6b-3cf1-4d3e-b490-a71915870c20 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:42.752976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:42.797340 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:42.798294 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:42.798583 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:42.798864 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] PATH_INFO: `/v3/users/30fc3e8da26d4079bfba618de56012fa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:42.800150 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30fc3e8da26d4079bfba618de56012fa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:42.802157 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:42.986291 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30fc3e8da26d4079bfba618de56012fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:42.992942 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30fc3e8da26d4079bfba618de56012fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.063295 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30fc3e8da26d4079bfba618de56012fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.063954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30fc3e8da26d4079bfba618de56012fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.064562 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30fc3e8da26d4079bfba618de56012fa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.082331 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1440/2869] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:42 2022] DELETE /identity/v3/users/30fc3e8da26d4079bfba618de56012fa => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:43.087003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039a1-c209-47ae-8c57-a084c6d27e7d None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:43.087526 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039a1-c209-47ae-8c57-a084c6d27e7d None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:43.087630 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c039a1-c209-47ae-8c57-a084c6d27e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:43.105585 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-07c039a1-c209-47ae-8c57-a084c6d27e7d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:43.106803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-07c039a1-c209-47ae-8c57-a084c6d27e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:43.154881 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:43.165709 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1430/2870] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:43.176091 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:43.177529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:43.234581 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870553d2-401a-445f-85fc-f88510419ef2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:43.238424 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e68ef-1383-43f3-9d75-8d50ec00350a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:43.239014 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e68ef-1383-43f3-9d75-8d50ec00350a service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:43.239307 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e68ef-1383-43f3-9d75-8d50ec00350a service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:43.239586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e68ef-1383-43f3-9d75-8d50ec00350a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:43.249512 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e68ef-1383-43f3-9d75-8d50ec00350a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:43.250990 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e68ef-1383-43f3-9d75-8d50ec00350a service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:43.260652 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1441/2871] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:43.675384 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c039a1-c209-47ae-8c57-a084c6d27e7d None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:43.676920 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-07c039a1-c209-47ae-8c57-a084c6d27e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:43.690478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c039a1-c209-47ae-8c57-a084c6d27e7d None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:43.695294 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:43.696227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:43.696485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:43.696757 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] PATH_INFO: `/v3/projects/2aa0ad3377fe4fde828273a0c4874122` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:43.697984 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa0ad3377fe4fde828273a0c4874122)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:43.700129 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:43.795615 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa0ad3377fe4fde828273a0c4874122', 'request_id': 'req-e73697d4-fc52-43f5-9c02-91f93cadfd9e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.801748 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa0ad3377fe4fde828273a0c4874122', 'request_id': 'req-e73697d4-fc52-43f5-9c02-91f93cadfd9e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.874785 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa0ad3377fe4fde828273a0c4874122', 'request_id': 'req-e73697d4-fc52-43f5-9c02-91f93cadfd9e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.885563 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] The token cache is being invalidate because project 2aa0ad3377fe4fde828273a0c4874122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:43.885850 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.886497 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:43.888045 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1431/2872] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:43 2022] DELETE /identity/v3/projects/2aa0ad3377fe4fde828273a0c4874122 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:43.891999 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e68ef-1383-43f3-9d75-8d50ec00350a service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:43.901603 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e68ef-1383-43f3-9d75-8d50ec00350a service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:43.941915 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:43.957556 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:43.958459 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:43.958745 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:43.959023 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] PATH_INFO: `/v3/users/bc708c343a6642cf992127c0fd75338d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:43.960208 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc708c343a6642cf992127c0fd75338d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:43.962173 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:44.094204 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc708c343a6642cf992127c0fd75338d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.101222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc708c343a6642cf992127c0fd75338d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.170200 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc708c343a6642cf992127c0fd75338d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.170837 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc708c343a6642cf992127c0fd75338d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.171462 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-310f76f8-3907-4b20-8750-6279dc90203a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc708c343a6642cf992127c0fd75338d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.188908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1442/2873] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:26:43 2022] DELETE /identity/v3/users/bc708c343a6642cf992127c0fd75338d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:44.613627 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:44.615083 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:44.629481 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73697d4-fc52-43f5-9c02-91f93cadfd9e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:44.686802 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:44.687651 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:44.687937 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:44.688210 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] PATH_INFO: `/v3/projects/df8448eba39a48cb8e8dd7c0c15caae1` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:44.689363 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8448eba39a48cb8e8dd7c0c15caae1)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:44.691442 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:44.795869 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8448eba39a48cb8e8dd7c0c15caae1', 'request_id': 'req-5aad701b-705a-4555-8daa-4d29d599109a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.802026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8448eba39a48cb8e8dd7c0c15caae1', 'request_id': 'req-5aad701b-705a-4555-8daa-4d29d599109a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.873582 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8448eba39a48cb8e8dd7c0c15caae1', 'request_id': 'req-5aad701b-705a-4555-8daa-4d29d599109a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.884318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] The token cache is being invalidate because project df8448eba39a48cb8e8dd7c0c15caae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:26:44.884608 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.885242 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-5aad701b-705a-4555-8daa-4d29d599109a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:26:44.887508 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1432/2874] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:26:44 2022] DELETE /identity/v3/projects/df8448eba39a48cb8e8dd7c0c15caae1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:44.892420 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6553e-d14f-468e-a0ae-19de8f418eb1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:44.892877 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6553e-d14f-468e-a0ae-19de8f418eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:44.892997 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6553e-d14f-468e-a0ae-19de8f418eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:44.911718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-28b6553e-d14f-468e-a0ae-19de8f418eb1 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:44.912908 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-28b6553e-d14f-468e-a0ae-19de8f418eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:44.971497 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1443/2875] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:44.979469 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad50173-47ad-4d04-9f97-8b20ea4ddbe6 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:44.979763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad50173-47ad-4d04-9f97-8b20ea4ddbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:44.980046 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad50173-47ad-4d04-9f97-8b20ea4ddbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:44.999574 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-bad50173-47ad-4d04-9f97-8b20ea4ddbe6 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:45.001177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-bad50173-47ad-4d04-9f97-8b20ea4ddbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:45.009170 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1433/2876] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:45.013833 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6553e-d14f-468e-a0ae-19de8f418eb1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:45.023234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6553e-d14f-468e-a0ae-19de8f418eb1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:45.028048 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:45.028688 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:45.028971 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:45.029247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:45.029981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:26:45.030293 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:45.031886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:45.043576 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1444/2877] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:26:45.047564 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad50173-47ad-4d04-9f97-8b20ea4ddbe6 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:45.051968 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:45.057159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad50173-47ad-4d04-9f97-8b20ea4ddbe6 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:45.062558 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a558a-590b-4d29-ab20-5c35f49f4bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:45.070689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a558a-590b-4d29-ab20-5c35f49f4bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:45.070689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a558a-590b-4d29-ab20-5c35f49f4bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:45.070689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a558a-590b-4d29-ab20-5c35f49f4bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:45.070689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a558a-590b-4d29-ab20-5c35f49f4bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:45.070689 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a558a-590b-4d29-ab20-5c35f49f4bc8 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:45.165777 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1434/2878] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:26:45 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:45.170437 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:45.180292 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf627b-d3a3-4f4d-af44-de43112e291d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:45.224534 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:45.236859 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24172-02df-4770-a298-c5ad0b428d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:45.237634 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24172-02df-4770-a298-c5ad0b428d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:45.237920 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24172-02df-4770-a298-c5ad0b428d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:45.238233 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24172-02df-4770-a298-c5ad0b428d3e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:45.238912 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24172-02df-4770-a298-c5ad0b428d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:45.240883 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24172-02df-4770-a298-c5ad0b428d3e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:45.361035 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1445/2879] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:26:45 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:26:45.365150 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a558a-590b-4d29-ab20-5c35f49f4bc8 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:45.375961 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a558a-590b-4d29-ab20-5c35f49f4bc8 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:45.380400 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da5ac7-7499-4e6a-acf4-af81fd4f442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:45.381054 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5ac7-7499-4e6a-acf4-af81fd4f442a admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:45.381337 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5ac7-7499-4e6a-acf4-af81fd4f442a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:45.381612 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5ac7-7499-4e6a-acf4-af81fd4f442a admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:45.382362 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da5ac7-7499-4e6a-acf4-af81fd4f442a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:45.383943 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da5ac7-7499-4e6a-acf4-af81fd4f442a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:45.394169 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1435/2880] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:45.403182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24172-02df-4770-a298-c5ad0b428d3e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:45.413103 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24172-02df-4770-a298-c5ad0b428d3e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:45.419009 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1e8bf-3379-4dfe-a295-8dc42b97cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:45.419679 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e8bf-3379-4dfe-a295-8dc42b97cf41 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:45.420013 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e8bf-3379-4dfe-a295-8dc42b97cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:45.420299 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e8bf-3379-4dfe-a295-8dc42b97cf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:45.421039 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1e8bf-3379-4dfe-a295-8dc42b97cf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:45.422708 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1e8bf-3379-4dfe-a295-8dc42b97cf41 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:45.434649 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1446/2881] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:26:45.438839 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da5ac7-7499-4e6a-acf4-af81fd4f442a admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:45.448838 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da5ac7-7499-4e6a-acf4-af81fd4f442a admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:45.453387 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:45.454327 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:45.454619 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:45.455018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] PATH_INFO: `/v3/projects/2be1a655a3144b2eabecbccb7ecd8f4e/users/1db0eb81eeff4ae7ab9cec34c3ae1700/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:45.470047 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be1a655a3144b2eabecbccb7ecd8f4e, user_id=1db0eb81eeff4ae7ab9cec34c3ae1700, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:45.472823 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:45.555146 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1436/2882] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:26:45 2022] PUT /identity/v3/projects/2be1a655a3144b2eabecbccb7ecd8f4e/users/1db0eb81eeff4ae7ab9cec34c3ae1700/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:26:45.566407 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8861-d8c4-4af2-bd54-c438bac136f5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:45.566709 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8861-d8c4-4af2-bd54-c438bac136f5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:45.567019 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8861-d8c4-4af2-bd54-c438bac136f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:45.593096 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-621b8861-d8c4-4af2-bd54-c438bac136f5 None None] MFA Rules not processed for user `1db0eb81eeff4ae7ab9cec34c3ae1700`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:26:45.594385 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-621b8861-d8c4-4af2-bd54-c438bac136f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:45.658068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1447/2883] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:26:45.669520 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:26:45.671311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:26:45.727446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef0227-20ea-44ba-9c0b-7a2c171befb5 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:26:45.731783 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a499e45-6140-4048-9165-0de9bc11a85e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca08d82f02a24e0088aceff2b6ba307d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:26:45.732431 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499e45-6140-4048-9165-0de9bc11a85e service glance] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:26:45.732715 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499e45-6140-4048-9165-0de9bc11a85e service glance] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:26:45.733003 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499e45-6140-4048-9165-0de9bc11a85e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:26:45.741396 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a499e45-6140-4048-9165-0de9bc11a85e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:26:45.742865 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a499e45-6140-4048-9165-0de9bc11a85e service glance] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:26:45.753818 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1437/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:26:55.655317 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:26:55.749846 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:05.474052 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8861-d8c4-4af2-bd54-c438bac136f5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:05.576036 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8861-d8c4-4af2-bd54-c438bac136f5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:05.581324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:05.582222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:05.582516 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:05.582791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] PATH_INFO: `/v3/users/1db0eb81eeff4ae7ab9cec34c3ae1700` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:05.584017 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db0eb81eeff4ae7ab9cec34c3ae1700)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:05.586128 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:05.762301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db0eb81eeff4ae7ab9cec34c3ae1700'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:05.769747 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db0eb81eeff4ae7ab9cec34c3ae1700'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:05.832611 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db0eb81eeff4ae7ab9cec34c3ae1700'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:05.833222 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db0eb81eeff4ae7ab9cec34c3ae1700'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:05.833832 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db0eb81eeff4ae7ab9cec34c3ae1700'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:05.858707 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1448/2885] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:27:05 2022] DELETE /identity/v3/users/1db0eb81eeff4ae7ab9cec34c3ae1700 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:27:05.863138 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6b6f-ee87-4806-8168-c9495a13b3a9 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:05.863615 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6b6f-ee87-4806-8168-c9495a13b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:05.863730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6b6f-ee87-4806-8168-c9495a13b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:05.912063 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-517f6b6f-ee87-4806-8168-c9495a13b3a9 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:27:05.913311 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-517f6b6f-ee87-4806-8168-c9495a13b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:05.971177 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1438/2886] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:27:05.980716 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:05.982169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:06.024606 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:06.077138 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf1d3-7a20-4db0-8f08-4715e1b6ddcb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:06.081548 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ef567-2525-4131-b173-71ed6eac0243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:06.082247 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ef567-2525-4131-b173-71ed6eac0243 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:06.082547 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ef567-2525-4131-b173-71ed6eac0243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:06.082822 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ef567-2525-4131-b173-71ed6eac0243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:06.092044 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ef567-2525-4131-b173-71ed6eac0243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:06.093529 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ef567-2525-4131-b173-71ed6eac0243 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:06.103043 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1449/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:27:06.497346 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f6b6f-ee87-4806-8168-c9495a13b3a9 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:06.500289 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-517f6b6f-ee87-4806-8168-c9495a13b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:06.510770 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f6b6f-ee87-4806-8168-c9495a13b3a9 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:06.517670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:06.517670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:06.517670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:06.517670 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] PATH_INFO: `/v3/projects/2be1a655a3144b2eabecbccb7ecd8f4e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:06.518446 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be1a655a3144b2eabecbccb7ecd8f4e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:06.520371 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:06.657895 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be1a655a3144b2eabecbccb7ecd8f4e', 'request_id': 'req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:06.663929 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be1a655a3144b2eabecbccb7ecd8f4e', 'request_id': 'req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:06.736947 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be1a655a3144b2eabecbccb7ecd8f4e', 'request_id': 'req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:06.747872 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] The token cache is being invalidate because project 2be1a655a3144b2eabecbccb7ecd8f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:27:06.750205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:06.750205 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-f6cb68fd-8e50-43ef-8e0b-027e5b4c5b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:06.750429 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1439/2888] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:27:06 2022] DELETE /identity/v3/projects/2be1a655a3144b2eabecbccb7ecd8f4e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:27:06.755324 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64032d9-74ad-468b-ae66-6b9ec02aad9d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:06.755772 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64032d9-74ad-468b-ae66-6b9ec02aad9d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:06.755881 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64032d9-74ad-468b-ae66-6b9ec02aad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:06.794374 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d64032d9-74ad-468b-ae66-6b9ec02aad9d None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:27:06.795632 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d64032d9-74ad-468b-ae66-6b9ec02aad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:06.853447 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1450/2889] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:27:06.861135 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bcf6a-19f3-4876-888c-9e515f5c4e19 None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:06.861432 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bcf6a-19f3-4876-888c-9e515f5c4e19 None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:06.861719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bcf6a-19f3-4876-888c-9e515f5c4e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:06.879623 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-483bcf6a-19f3-4876-888c-9e515f5c4e19 None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:27:06.880820 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-483bcf6a-19f3-4876-888c-9e515f5c4e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:06.888703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1440/2890] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:27:06.893187 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64032d9-74ad-468b-ae66-6b9ec02aad9d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:06.903002 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64032d9-74ad-468b-ae66-6b9ec02aad9d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:06.908278 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:06.908909 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:06.909224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:06.909507 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:06.910275 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 30 12:27:06.910586 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:06.912185 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:06.923845 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1451/2891] 10.222.0.48 () {58 vars in 1152 bytes} [Mon May 30 12:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 30 12:27:06.927841 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bcf6a-19f3-4876-888c-9e515f5c4e19 None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:06.936686 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bcf6a-19f3-4876-888c-9e515f5c4e19 None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:06.941341 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4734d-718f-4b98-986d-15d1ee74a778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:06.942005 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4734d-718f-4b98-986d-15d1ee74a778 admin admin] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:06.942298 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4734d-718f-4b98-986d-15d1ee74a778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:06.942579 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4734d-718f-4b98-986d-15d1ee74a778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:06.943276 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4734d-718f-4b98-986d-15d1ee74a778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:06.945206 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4734d-718f-4b98-986d-15d1ee74a778 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:07.026248 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1441/2892] 10.222.0.48 () {60 vars in 1152 bytes} [Mon May 30 12:27:06 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 30 12:27:07.027470 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:07.037950 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3284d-79bc-4e8a-a8e6-f5b4de4bd084 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:07.094025 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c569551-61e4-4ce6-9e42-0bf3cd63c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:07.094696 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569551-61e4-4ce6-9e42-0bf3cd63c0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:07.094981 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569551-61e4-4ce6-9e42-0bf3cd63c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:07.095257 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c569551-61e4-4ce6-9e42-0bf3cd63c0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:07.095951 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c569551-61e4-4ce6-9e42-0bf3cd63c0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:07.097873 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c569551-61e4-4ce6-9e42-0bf3cd63c0f9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:07.189162 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1452/2893] 10.222.0.48 () {60 vars in 1143 bytes} [Mon May 30 12:27:07 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 30 12:27:07.193204 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4734d-718f-4b98-986d-15d1ee74a778 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:07.203921 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4734d-718f-4b98-986d-15d1ee74a778 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:07.208658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ddfd-cb66-4c3e-88af-cdf1232a824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:07.209317 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ddfd-cb66-4c3e-88af-cdf1232a824b admin admin] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:07.209600 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ddfd-cb66-4c3e-88af-cdf1232a824b admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:07.209874 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193ddfd-cb66-4c3e-88af-cdf1232a824b admin admin] PATH_INFO: `/v3/roles` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:07.210622 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193ddfd-cb66-4c3e-88af-cdf1232a824b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:07.212227 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193ddfd-cb66-4c3e-88af-cdf1232a824b admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:07.222471 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1442/2894] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:27:07.237232 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c569551-61e4-4ce6-9e42-0bf3cd63c0f9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:07.247225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c569551-61e4-4ce6-9e42-0bf3cd63c0f9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:07.252446 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e98d13-e47b-4b57-be5d-e205fbe0c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:07.253107 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98d13-e47b-4b57-be5d-e205fbe0c21d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:07.253399 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98d13-e47b-4b57-be5d-e205fbe0c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:07.253683 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e98d13-e47b-4b57-be5d-e205fbe0c21d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:07.254506 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e98d13-e47b-4b57-be5d-e205fbe0c21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:07.257241 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e98d13-e47b-4b57-be5d-e205fbe0c21d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:07.257621 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:07.267976 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1453/2895] 10.222.0.48 () {58 vars in 1121 bytes} [Mon May 30 12:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 30 12:27:07.272007 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ddfd-cb66-4c3e-88af-cdf1232a824b admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:07.282530 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193ddfd-cb66-4c3e-88af-cdf1232a824b admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:07.287220 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:07.288094 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:07.288385 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:07.288665 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] PATH_INFO: `/v3/projects/1fd262b306d648b2adcf4c05bad99436/users/84d13e57068b49b3b5bc8a035e06a28c/roles/ec78785738f441ec9be64e122e252506` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:07.303219 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd262b306d648b2adcf4c05bad99436, user_id=84d13e57068b49b3b5bc8a035e06a28c, role_id=ec78785738f441ec9be64e122e252506)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:07.305871 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:07.308114 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:07.377401 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1443/2896] 10.222.0.48 () {60 vars in 1482 bytes} [Mon May 30 12:27:07 2022] PUT /identity/v3/projects/1fd262b306d648b2adcf4c05bad99436/users/84d13e57068b49b3b5bc8a035e06a28c/roles/ec78785738f441ec9be64e122e252506 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:27:07.387591 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d926-7e21-497d-a762-2ec0c4c6a848 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:07.387911 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d926-7e21-497d-a762-2ec0c4c6a848 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:07.388224 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d926-7e21-497d-a762-2ec0c4c6a848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:07.415675 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-aef0d926-7e21-497d-a762-2ec0c4c6a848 None None] MFA Rules not processed for user `84d13e57068b49b3b5bc8a035e06a28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:27:07.416919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aef0d926-7e21-497d-a762-2ec0c4c6a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:07.479986 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1454/2897] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 30 12:27:07.491447 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:07.493103 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:07.549719 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eec46-42de-4ebc-b097-a6848f05d770 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:07.553440 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4d11748f14d40628414db49de696fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:07.554116 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:07.554513 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:07.554803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:07.563764 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:07.565226 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:07.573888 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1444/2898] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:27:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:27:16.518182 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d926-7e21-497d-a762-2ec0c4c6a848 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:16.524169 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aef0d926-7e21-497d-a762-2ec0c4c6a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:16.574181 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d926-7e21-497d-a762-2ec0c4c6a848 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:16.578258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:16.578897 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:16.579179 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:16.579449 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:16.581235 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:16.637774 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:16.639813 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:16.648753 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1455/2899] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:27:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:27:17.570026 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:17.761125 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:17.761988 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:17.848162 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb1c28-5dc6-4fc8-a106-723ad6deb504 service cinder] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:17.853849 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:17.854549 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:17.854840 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:17.855118 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:17.856918 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:17.869855 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:17.871489 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:17.882837 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1445/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:27:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:27:20.373148 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:20.389913 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270368-ae18-42f4-9f51-cf006baa54aa service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:20.397112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca17dc23a924e41a657db3122445923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:20.397112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:20.397112 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:20.397478 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:20.399258 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:20.414281 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:20.415886 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:20.435818 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1456/2901] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:27:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:27:23.166491 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:23.176485 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda47c25-fe68-4438-9022-7f1a9f15dfda service nova] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:23.180122 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:23.180763 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:23.181069 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:23.181352 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:23.183163 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:23.245841 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:23.247333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:23.257997 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1446/2902] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:27:30.422364 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:30.697719 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:30.699304 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:30.713308 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8afa-75ff-4237-9f3d-ad2dfbf972fb service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:30.719255 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:30.720113 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:30.720401 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:30.720686 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] PATH_INFO: `/v3/users/5a249c458f4d40a484ad51d33a9bdeac` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:30.721879 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a249c458f4d40a484ad51d33a9bdeac)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:30.723842 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:30.881954 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a249c458f4d40a484ad51d33a9bdeac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:30.889338 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a249c458f4d40a484ad51d33a9bdeac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:30.937081 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a249c458f4d40a484ad51d33a9bdeac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:30.937694 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a249c458f4d40a484ad51d33a9bdeac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:30.938383 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a249c458f4d40a484ad51d33a9bdeac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:30.957301 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1457/2903] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:27:30 2022] DELETE /identity/v3/users/5a249c458f4d40a484ad51d33a9bdeac => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:27:31.202208 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:31.212439 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc621-2d36-4093-89bf-5071dc148bd6 service neutron] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:31.277913 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:31.278879 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:31.279183 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:31.279461 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] PATH_INFO: `/v3/projects/d965a13a1593484b8ceeeb8f6d870efe` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:31.280650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d965a13a1593484b8ceeeb8f6d870efe)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:31.282664 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:31.305191 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=100 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:31.371583 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd965a13a1593484b8ceeeb8f6d870efe', 'request_id': 'req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.378342 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd965a13a1593484b8ceeeb8f6d870efe', 'request_id': 'req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.428428 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd965a13a1593484b8ceeeb8f6d870efe', 'request_id': 'req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.440703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] The token cache is being invalidate because project d965a13a1593484b8ceeeb8f6d870efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:27:31.440992 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.441650 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.443216 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1447/2904] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:27:31 2022] DELETE /identity/v3/projects/d965a13a1593484b8ceeeb8f6d870efe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:27:31.447329 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:31.448806 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:31.463310 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4ef10-ca93-420d-854c-f41d59bde22a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:31.520925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:31.521984 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:31.522348 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:31.522661 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] PATH_INFO: `/v3/users/7313f4dcc8e948ae8a430dc6f667362f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:31.524160 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7313f4dcc8e948ae8a430dc6f667362f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:31.526778 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:31.722306 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7313f4dcc8e948ae8a430dc6f667362f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.729109 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7313f4dcc8e948ae8a430dc6f667362f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.799697 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7313f4dcc8e948ae8a430dc6f667362f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.800318 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7313f4dcc8e948ae8a430dc6f667362f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.800925 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7313f4dcc8e948ae8a430dc6f667362f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:31.809361 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:31.819268 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1458/2905] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:27:31 2022] DELETE /identity/v3/users/7313f4dcc8e948ae8a430dc6f667362f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:27:32.093379 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:32.095044 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:32.117875 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567aa3-dcb1-4d15-9b1a-a5d2832fad93 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:32.172033 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:32.173380 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:32.173676 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:32.174064 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] PATH_INFO: `/v3/projects/8f4a8f0e87f54e168fba0f484c13fe0e` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:32.175761 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4a8f0e87f54e168fba0f484c13fe0e)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:32.177738 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:32.281480 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4a8f0e87f54e168fba0f484c13fe0e', 'request_id': 'req-7564eaab-27ab-429a-9f33-17bf144a4e9d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:32.287936 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4a8f0e87f54e168fba0f484c13fe0e', 'request_id': 'req-7564eaab-27ab-429a-9f33-17bf144a4e9d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:32.393842 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4a8f0e87f54e168fba0f484c13fe0e', 'request_id': 'req-7564eaab-27ab-429a-9f33-17bf144a4e9d'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:32.405781 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] The token cache is being invalidate because project 8f4a8f0e87f54e168fba0f484c13fe0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:27:32.406117 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:32.406787 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-7564eaab-27ab-429a-9f33-17bf144a4e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:32.408382 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1448/2906] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:27:32 2022] DELETE /identity/v3/projects/8f4a8f0e87f54e168fba0f484c13fe0e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 30 12:27:41.925164 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:42.402437 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:48.535111 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:48.536582 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:48.553825 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c711900-f6b8-49c1-81f7-4910f9679677 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:48.615617 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:48.616526 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:48.616791 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:48.617071 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] PATH_INFO: `/v3/users/84d13e57068b49b3b5bc8a035e06a28c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:48.618297 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d13e57068b49b3b5bc8a035e06a28c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:48.623332 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:48.839179 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d13e57068b49b3b5bc8a035e06a28c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:48.848131 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d13e57068b49b3b5bc8a035e06a28c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:48.942154 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d13e57068b49b3b5bc8a035e06a28c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:48.943069 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d13e57068b49b3b5bc8a035e06a28c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:48.943405 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d13e57068b49b3b5bc8a035e06a28c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:48.962118 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1459/2907] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:27:48 2022] DELETE /identity/v3/users/84d13e57068b49b3b5bc8a035e06a28c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:27:48.966704 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0903a-5686-4fc0-b605-1becb0ccc82b None None] REQUEST_METHOD: `POST` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:48.968259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0903a-5686-4fc0-b605-1becb0ccc82b None None] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:48.968259 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0903a-5686-4fc0-b605-1becb0ccc82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:48.984448 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.auth.core [None req-02e0903a-5686-4fc0-b605-1becb0ccc82b None None] MFA Rules not processed for user `9fbe87ad0d3c4f67b20c51a5a999566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80343) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:27:48.985658 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-02e0903a-5686-4fc0-b605-1becb0ccc82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:49.044514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1449/2908] 10.222.0.48 () {58 vars in 957 bytes} [Mon May 30 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:27:49.053923 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:49.055429 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:49.112296 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881969e8-4771-46f8-8873-c620edb7e276 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:49.115896 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f431b6c-806c-4a72-a11f-bf3fc047a06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35763651d4614bf68400b5efce4113a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:49.116602 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431b6c-806c-4a72-a11f-bf3fc047a06d service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:49.116898 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431b6c-806c-4a72-a11f-bf3fc047a06d service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:49.117174 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431b6c-806c-4a72-a11f-bf3fc047a06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:49.125919 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431b6c-806c-4a72-a11f-bf3fc047a06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:49.127869 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431b6c-806c-4a72-a11f-bf3fc047a06d service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:49.137237 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1460/2909] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:27:49.571794 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0903a-5686-4fc0-b605-1becb0ccc82b None None] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:49.573287 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-02e0903a-5686-4fc0-b605-1becb0ccc82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:49.585747 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0903a-5686-4fc0-b605-1becb0ccc82b None None] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:49.591075 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:49.591941 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:49.592225 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:49.593001 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] PATH_INFO: `/v3/projects/1fd262b306d648b2adcf4c05bad99436` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:49.594535 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd262b306d648b2adcf4c05bad99436)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:49.596389 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:49.707832 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd262b306d648b2adcf4c05bad99436', 'request_id': 'req-d3460f1a-b57e-4450-b518-97d6fc70f59e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:49.713978 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd262b306d648b2adcf4c05bad99436', 'request_id': 'req-d3460f1a-b57e-4450-b518-97d6fc70f59e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:49.804994 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd262b306d648b2adcf4c05bad99436', 'request_id': 'req-d3460f1a-b57e-4450-b518-97d6fc70f59e'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:49.816171 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] The token cache is being invalidate because project 1fd262b306d648b2adcf4c05bad99436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80343) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:27:49.816462 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:49.817091 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:49.819067 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1450/2910] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:27:49 2022] DELETE /identity/v3/projects/1fd262b306d648b2adcf4c05bad99436 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:27:50.671752 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699217d-234a-4b7a-b395-2400b8140f62 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:50.674638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699217d-234a-4b7a-b395-2400b8140f62 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:50.674638 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699217d-234a-4b7a-b395-2400b8140f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:50.699918 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7699217d-234a-4b7a-b395-2400b8140f62 None None] MFA Rules not processed for user `987e7ae8a7a24af8b391474e711051b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 30 12:27:50.701116 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7699217d-234a-4b7a-b395-2400b8140f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:50.710123 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:50.765969 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1461/2911] 10.222.0.48 () {58 vars in 967 bytes} [Mon May 30 12:27:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 30 12:27:50.807328 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:50.808722 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:50.877569 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3460f1a-b57e-4450-b518-97d6fc70f59e admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:50.882514 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eb03f76d840406ebe2365fd092d72f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:50.883159 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:50.883449 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:50.883727 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:50.891730 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:50.893318 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:50.901811 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1451/2912] 10.222.0.48 () {60 vars in 1384 bytes} [Mon May 30 12:27:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 30 12:27:55.199387 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699217d-234a-4b7a-b395-2400b8140f62 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:55.200797 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7699217d-234a-4b7a-b395-2400b8140f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:55.275234 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699217d-234a-4b7a-b395-2400b8140f62 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:55.280505 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:55.281152 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:55.281440 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:55.281718 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:55.283699 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:55.295064 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:55.296623 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:55.307286 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1462/2913] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:27:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:27:58.991743 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:58.993312 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:59.008717 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:59.059256 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb53239-5df6-4e56-8311-defd0e6ff3b9 service swift] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:59.064356 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:59.065245 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:59.065529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:59.065804 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] PATH_INFO: `/v3/users/a18fa6da386c4d07b41dea41a661d839` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:59.067072 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18fa6da386c4d07b41dea41a661d839)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:59.068982 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:59.258908 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18fa6da386c4d07b41dea41a661d839'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.266109 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18fa6da386c4d07b41dea41a661d839'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.267459 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18fa6da386c4d07b41dea41a661d839'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.268077 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18fa6da386c4d07b41dea41a661d839'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.324209 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18fa6da386c4d07b41dea41a661d839'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.342620 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1452/2914] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:27:58 2022] DELETE /identity/v3/users/a18fa6da386c4d07b41dea41a661d839 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:27:59.588750 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:59.605782 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e501-b492-4bff-90b6-300328d124fe service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:59.665799 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:59.666695 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:59.666983 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:59.667266 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] PATH_INFO: `/v3/projects/14ee2ded197647ffa9b76debd5ae01b7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:59.668517 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ee2ded197647ffa9b76debd5ae01b7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:59.670475 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:27:59.765798 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:27:59.769931 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ee2ded197647ffa9b76debd5ae01b7', 'request_id': 'req-92f74137-6977-41ac-99d1-e1d240378992'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.877711 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ee2ded197647ffa9b76debd5ae01b7', 'request_id': 'req-92f74137-6977-41ac-99d1-e1d240378992'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.884068 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ee2ded197647ffa9b76debd5ae01b7', 'request_id': 'req-92f74137-6977-41ac-99d1-e1d240378992'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.894933 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] The token cache is being invalidate because project 14ee2ded197647ffa9b76debd5ae01b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:27:59.895225 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.895858 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:27:59.897404 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1463/2915] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:27:59 2022] DELETE /identity/v3/projects/14ee2ded197647ffa9b76debd5ae01b7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:27:59.904835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:27:59.904835 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:27:59.917478 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed131d83-c02c-4464-bf65-61c5b2f31854 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:27:59.976566 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:27:59.977529 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:27:59.977830 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:27:59.978120 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] PATH_INFO: `/v3/users/0d40077d968042fa92f07918841facb4` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:27:59.979360 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d40077d968042fa92f07918841facb4)` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:27:59.981283 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:28:00.140732 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:28:00.149847 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d40077d968042fa92f07918841facb4'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.156877 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d40077d968042fa92f07918841facb4'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.158215 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d40077d968042fa92f07918841facb4'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.158831 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d40077d968042fa92f07918841facb4'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.227377 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.notifications [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d40077d968042fa92f07918841facb4'} {{(pid=80343) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.245166 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1453/2916] 10.222.0.48 () {58 vars in 1223 bytes} [Mon May 30 12:27:59 2022] DELETE /identity/v3/users/0d40077d968042fa92f07918841facb4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:28:00.486792 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:28:00.488276 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:28:00.501630 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f74137-6977-41ac-99d1-e1d240378992 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:28:00.557198 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbe87ad0d3c4f67b20c51a5a999566b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9afd60ec71934d3cbf3f12a53b6e9a17', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:28:00.558124 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:28:00.558410 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:28:00.558687 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] PATH_INFO: `/v3/projects/b0ce9d519c39444fbb011c47d0550739` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:28:00.559856 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ce9d519c39444fbb011c47d0550739)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:28:00.561785 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:28:00.671156 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ce9d519c39444fbb011c47d0550739', 'request_id': 'req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.735685 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ce9d519c39444fbb011c47d0550739', 'request_id': 'req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.742790 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ce9d519c39444fbb011c47d0550739', 'request_id': 'req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.754003 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] The token cache is being invalidate because project b0ce9d519c39444fbb011c47d0550739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 30 12:28:00.754322 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.754965 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0e104170-48eb-45e3-aa1d-2e1ed6deb8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 30 12:28:00.756545 dv-cinder-840512-2-smb devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1464/2917] 10.222.0.48 () {58 vars in 1232 bytes} [Mon May 30 12:28:00 2022] DELETE /identity/v3/projects/b0ce9d519c39444fbb011c47d0550739 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 30 12:28:10.289198 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:28:10.750122 dv-cinder-840512-2-smb devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:29:23.346915 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] Authenticating user token {{(pid=80343) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 30 12:29:23.348331 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:29:23.436335 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe85ba-5ed1-4f81-a1d3-2f7e888a6307 admin admin] Validating token access rules against request {{(pid=80343) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 30 12:29:23.493625 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c99bdd-e18e-44e8-95b7-6f90ccdf0bc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49f847d54d334342b54d6f3189166ef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d3f55587084ccbaa3331cc71ea1ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80343) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 30 12:29:23.494333 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99bdd-e18e-44e8-95b7-6f90ccdf0bc0 service placement] REQUEST_METHOD: `GET` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 30 12:29:23.494626 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99bdd-e18e-44e8-95b7-6f90ccdf0bc0 service placement] SCRIPT_NAME: `/identity` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 30 12:29:23.494907 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99bdd-e18e-44e8-95b7-6f90ccdf0bc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80343) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 30 12:29:23.497203 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.fernet_utils [None req-b7c99bdd-e18e-44e8-95b7-6f90ccdf0bc0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80343) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 30 12:29:23.508113 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c99bdd-e18e-44e8-95b7-6f90ccdf0bc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 30 12:29:23.509703 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c99bdd-e18e-44e8-95b7-6f90ccdf0bc0 service placement] RBAC: Authorization granted {{(pid=80343) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 30 12:29:23.520018 dv-cinder-840512-2-smb devstack@keystone.service[80343]: [pid: 80343|app: 0|req: 1454/2918] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 30 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 30 12:29:33.515803 dv-cinder-840512-2-smb devstack@keystone.service[80343]: DEBUG dbcounter [-] [80343] Writing DB stats keystone:SELECT=67 {{(pid=80343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}